PokeNet: Learning Kinematic Models of Articulated Objects from Human Observations

Anmol Gupta, Weiwei Gu, Omkar Patil, Jun Ki Lee, Nakul Gopalan · 2026

Read PokeNet: Learning Kinematic Models of Articulated Objects from Human Observations by Anmol Gupta, Weiwei Gu, Omkar Patil, Jun Ki Lee, Nakul Gopalan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02741.txt.

Description

Anmol Gupta and 4 co-authors teach robots the joint structure of unfamiliar objects by watching one human demonstration, in a 2026 paper. Articulation models tell a robot how drawers slide and doors swing, enabling later manipulation. Earlier methods needed prior knowledge of joint counts or types, missed occluded joints revealed only during interaction, or demanded many multi-view images.

PokeNet works from a sequence of point cloud observations of a person manipulating an unknown object. It predicts joint parameters, infers the order in which joints must be operated, and tracks joint states over time. Manipulation order matters for objects like dishwashers, where one joint unlocks another. Across diverse objects, including unseen categories, joint axis and state estimation accuracy improved by over twenty-seven percent on average over leading methods. Gains held in simulation and in the real world.

Catalog record

CREATORAnmol Gupta, Weiwei Gu, Omkar Patil, Jun Ki Lee, Nakul Gopalan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02741

Browse the full library · About the Tower of Babel