CoRMA: Contrastive RMA for Contact-Rich Meta-Adaptation
Wentian Wang, Chutong Wen, Hongxu Ma, Wuhao Wang, Zhexiong Xue, Abdul Haseeb Nizamani, Dandi Zhou, Xinhai Sun, Jian-Qiao Zhu · 2026
Read CoRMA: Contrastive RMA for Contact-Rich Meta-Adaptation by Wentian Wang, Chutong Wen, Hongxu Ma, Wuhao Wang, Zhexiong Xue, Abdul Haseeb Nizamani, Dandi Zhou, Xinhai Sun, Jian-Qiao Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22082.txt.
Introduction
Wentian Wang and co-authors present CoRMA, contrastive robotic motor adaptation for contact-rich meta-adaptation in force-dominant assembly. It swaps raw simulator-parameter adaptation for a compact 6D simulator-only semantic contact context describing contact onset, lateral engagement, guided shifts, contact direction, and jamming. A causal Transformer adapter infers this context online from force and related signals. Tested in Isaac Lab and Isaac Sim 5.0 and on a real Marvin arm, CoRMA keeps higher verified real success under target-pose noise than FORGE baselines, which degrade substantially on hardware.
Catalog record
| CREATOR | Wentian Wang, Chutong Wen, Hongxu Ma, Wuhao Wang, Zhexiong Xue, Abdul Haseeb Nizamani, Dandi Zhou, Xinhai Sun, Jian-Qiao Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39536 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22082
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CoRMA: Contrastive RMA for Contact-Rich Meta-Adaptation Wentian Wang, Chutong Wen, Hongxu Ma, Wuhao Wang, Zhexiong Xue, Abdul Haseeb Nizamani, Dandi Zhou, Xinhai Sun, Jian-Qiao Zhu Abstract We present CoRMA (Contrastive Robotic Motor Adaptation), a context-based meta-adaptation framework that modifies RMA for force-dominant assembly. CoRMA replaces raw simulator-parameter adaptation with a compact 6D simulator-only semantic contact context describing contact onset, lateral engagement, guided transition, contact direction, and jamming. A deployable causal Transformer adapter infers this context online from force, proprioceptive, and action histories using semantic regression and a force-regime contrastive objective. At deployment, oracle context is removed and replaced by the inferred context, enabling within-episode adaptation without demonstrations, privileged inputs, or gradient updates. We evaluate CoRMA on PegInsert, GearMesh, and NutThread in Isaac Lab / Isaac Sim 5.0 and deploy on a real Marvin arm. Compared with FORGE baselines that achieve high simulation success but degrade substantially on hardware, CoRMA retains higher verified real success under controlled target-pose noise. These results support semantic contact inference as a reusable adaptation interface within a related assembly task family, while broader unseen-task generalization and Real2Sim calibration remain future work. Keywords: Contact-Rich Assembly, Sim-to-Real, Meta Learning Figure 1: CoRMA pipeline overview. Stage 1 trains privileged contact-aware policies in Isaac Lab FORGE using RL-Games PPO with a simulator-only 6D semantic contact latent z_{t} . Stage 2 trains a causal Transformer adapter to infer \hat{z}_{t} from deployable force, proprioceptive, and action histories, using semantic regression and force-regime contrastive learning. Stage 3 removes oracle z_{t} and injects the adapter prediction \hat{z}_{t} into the policy during fine-tuning and real deployment. This implements an RMA-style non-cheating deployment interface for context-based meta-adaptation: privileged contact semantics are used only as simulation supervision, while the deployed controller adapts online from sensor history. Real logs are used for deployment diagnostics and motivate future Real2Sim calibration. 1 Introduction Contact-rich robotic assembly [ 15 , 28 , 27 ] remains a long-standing challenge in robotics. Tasks such as PegInsert, GearMesh, and NutThread require precise geometric alignment, sustained contact regulation, and recovery from intermittent failures over long horizons. Unlike free-space manipulation, small mismatches in contact geometry, friction, compliance, sensing, or actuation can produce jamming, unstable transitions, or irreversible failure. Robust assembly therefore depends not only on generating motion, but also on interpreting what a sequence of contact forces means during execution. Recent sim-to-real assembly systems, including FORGE [ 16 ] , show that reinforcement learning can produce robust contact-rich behaviors under uncertainty. However, these policies are still commonly trained and tuned in a task-specific manner. New parts, fixtures, or objectives may require new policy training or additional real-world calibration, even when the underlying contact mechanisms are closely related. Many successful manipulation systems also rely on demonstration-heavy pipelines, such as behavior cloning [ 19 , 21 ] , imitation learning [ 23 , 1 , 7 , 8 ] , or residual sim-to-real fine-tuning [ 9 , 25 , 2 ] . Classical robotics has addressed manipulation uncertainty through adaptive control and disturbance compensation, typically for tracking and stabilization rather than for learning reusable cross-task contact representations [ 22 ] . While effective, these approaches can be costly to extend across task variants and operating conditions because they require repeated data collection, calibration, or adaptation whenever the setup changes [ 11 ] . This motivates a meta-adaptation view of contact-rich assembly [ 20 , 6 ] : instead of learning each assembly policy in isolation, the robot should infer an interaction context online and reuse this context across related tasks. Teacher–student frameworks such as Rapid Motor Adaptation (RMA) [ 10 ] provide a useful template for this goal. RMA trains a privileged teacher in simulation and learns an adapter that predicts privileged context from deployable sensor history, so privileged information is used only during training while deployment relies only on onboard observations. For contact-rich assembly, however, the standard RMA formulation is not directly sufficient. Many manipulation-oriented adaptation systems rely on visual or object-centric cues, whereas our deployment setting uses force, proprioception, and action history. Once contact begins, the critical question is not only where the object is, but whether the interaction is in free motion, first touch, lateral engagement, guided sliding, thread or tooth engagement, or a jammed regime. We propose CoRMA, a force-based context adaptation framework that modifies RMA for contact-rich assembly. CoRMA is built on the hypothesis that related assembly tasks share recurring semantic contact structure . Instead of using raw simulator parameters as privileged context, CoRMA constructs a compact 6D Privileged Z describing contact onset, lateral engagement, guided contact transition, contact direction along two axes, and jam or stick–slip tendency. Force is treated as deployable evidence, while Privileged Z represents the semantic interpretation of contact that is useful for control. Because raw force histories can be ambiguous under pointwise regression, CoRMA uses a causal Transformer adapter to infer \hat{z}_{t} from force/action histories and adds a force-regime contrastive objective [ 13 , 5 ] to organize histories by contact semantics rather than by raw trajectory similarity. Fig. 1 summarizes the CoRMA pipeline. Stage 1 trains privileged contact-aware policies in Isaac Lab FORGE using RL-Games PPO with z_{t} appended to the observation. Stage 2 trains the CoRMA adapter to predict \hat{z}_{t} from deployable history using semantic regression and force-regime contrastive learning. Stage 3 removes oracle z_{t} and injects the adapter prediction \hat{z}_{t} into the policy during fine-tuning and real deployment. In this sense, CoRMA is a context-based meta-adaptation system rather than a MAML-style gradient inner-loop method: adaptation happens online through the inferred contact context, without demonstrations, privileged inputs, or test-time gradient updates. We evaluate CoRMA on PegInsert, GearMesh, and NutThread in simulation and on a real Marvin arm. Our current evaluation tests reuse within a related contact-rich assembly family rather than unconstrained generalization to arbitrary unseen tasks, and the results show that semantic contact inference can reduce the real-world degradation observed in strong task-specific FORGE baselines. 2 Related Works 2.1 Meta-Reinforcement Learning and Context Adaptation Meta-RL methods aim to train agents that can adapt rapidly to new tasks or dynamics by leveraging experience over a task distribution. Gradient-based methods such as MAML [ 6 ] learn parameters that can be fine-tuned with a small number of gradient steps, but require inner-loop updates and additional adaptation data at test time. Recurrent meta-RL methods such as RL 2 [ 4 ] instead learn an implicit adaptation procedure in the hidden state of a recurrent policy. Context-based methods such as PEARL [ 14 ] and variBAD [ 29 ] infer an explicit latent context under partial observability, allowing the policy to condition on an estimated task or dynamics belief. CoRMA follows this context-based view, but specializes it to contact-rich assembly. Rather than learning a generic task embedding only from rewards, CoRMA uses simulator-derived semantic contact labels as supervised targets for an amortized context estimator. At deployment, adaptation occurs through online latent inference from force, proprioceptive, and action history, without demonstrations or MAML-style gradient updates. Thus, CoRMA is best understood as context-based meta-adaptation within a related assembly task family. 2.2 Privileged Adaptation and Rapid Motor Adaptation RMA trains a privileged teacher policy in simulation and then learns an adaptation module that predicts the teacher’s latent context from deployable history. This privileged-train