Physically-Grounded Goal Imagination: Physics-Informed Variational Autoencoder for Self-Supervised Reinforcement Learning

Lan Thi Ha Nguyen, Kien Ton Manh, Anh Do Duc, Nam Pham Hai · 2025

Read Physically-Grounded Goal Imagination: Physics-Informed Variational Autoencoder for Self-Supervised Reinforcement Learning by Lan Thi Ha Nguyen, Kien Ton Manh, Anh Do Duc, Nam Pham Hai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06745.txt.

Description

Lan Thi Ha Nguyen and co-authors ground a robot's daydreams in physics so the goals it imagines for itself stay achievable. Self-supervised robots learn skills by inventing practice goals, yet goal generators based on autoencoders often propose physically impossible targets that waste training. Their system, PI-RIG, folds physical law into the goal generator itself.

The autoencoder's hidden space splits into physics variables describing object dynamics and appearance factors describing how scenes look. Physics equations and conservation laws police that side during training. The resulting goals respect object permanence, collisions, and dynamic feasibility. Experiments on reaching, pushing, and pick-and-place tasks showed better goal quality, exploration, and skill learning.

Catalog record

CREATORLan Thi Ha Nguyen, Kien Ton Manh, Anh Do Duc, Nam Pham Hai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06745

Browse the full library · About the Tower of Babel