Noise-conditioned Energy-based Annealed Rewards (NEAR): A Generative Framework for Imitation Learning from Observation
Anish Abhijit Diwan, Julen Urain, Jens Kober, Jan Peters · 2025
Read Noise-conditioned Energy-based Annealed Rewards (NEAR): A Generative Framework for Imitation Learning from Observation by Anish Abhijit Diwan, Julen Urain, Jens Kober, Jan Peters (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14856.txt.
Description
Anish Diwan, Julen Urain, Jens Kober, and Jan Peters introduced NEAR in 2025, a framework that teaches robots to imitate motion from observation alone. The expert's motion is given only as states, with no recorded actions, and the motions depend on physics in complex ways. Their method builds rewards from the expert data instead of hand-designing them.
NEAR makes several noisy copies of the expert data spread and learns smooth energy functions for them by denoising score matching. Those energy functions serve as rewards for reinforcement learning. A switching plan moves between the learned rewards so they stay well defined on the samples the policy creates. Tests cover hard humanoid tasks such as locomotion and martial arts style moves named in the full text. Readers get a generative route to imitation without action labels.
Catalog record
| CREATOR | Anish Abhijit Diwan, Julen Urain, Jens Kober, Jan Peters |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-14856