ConTraIRL: Factorized Contrastive Abstractions for Transferable IRL

Yikang Gui, Bikramjit Banerjee, Prashant Doshi · 2026

Read ConTraIRL: Factorized Contrastive Abstractions for Transferable IRL by Yikang Gui, Bikramjit Banerjee, Prashant Doshi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03017.txt.

Description

Gui, Banerjee, and Doshi fix a weak point in inverse reinforcement learning: rewards that fail to travel. A learned reward can break when a task pairs new dynamics with new goals. Their design, ConTraIRL, splits the two factors into two learned codes. One code stands for how the world moves. One stands for what the goal is.

Two encoders map each scene into a dynamics space and a goal space. A paired contrast loss trains both. Time alignment makes the dynamics code shrug off goal shifts. The goal code shrugs off dynamics shifts. That split lets the team infer rewards for pairs not seen in training. Tests on control benchmarks show few-shot transfer to new pairs. Sample use and reward recovery both beat past transfer baselines. The work targets rewards that can be reused when tasks are mixed in new ways.

Catalog record

CREATORYikang Gui, Bikramjit Banerjee, Prashant Doshi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03017

Browse the full library · About the Tower of Babel