Embedding Morphology into Transformers for Cross-Robot Policy Learning

Kei Suzuki, Jing Liu, Ye Wang, Chiori Hori, Matthew Brand, Diego Romeres, Toshiaki Koike-Akino · 2026

Read Embedding Morphology into Transformers for Cross-Robot Policy Learning by Kei Suzuki, Jing Liu, Ye Wang, Chiori Hori, Matthew Brand, Diego Romeres, Toshiaki Koike-Akino (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00182.txt.

Description

Suzuki and colleagues present a transformer policy for cross-robot learning that bakes body shape into decisions through three tricks. Kinematic tokens split actions across joints and squeeze time via per-joint chunking. A topology-aware attention bias codes body topology into self-attention, pushing messages along body links. Joint-attribute conditioning adds per-joint descriptors for meaning beyond links. Across bodies, the structured design consistently beats a vanilla pi0.5 vision-language-action baseline, lifting robustness within and across bodies.

Catalog record

CREATORKei Suzuki, Jing Liu, Ye Wang, Chiori Hori, Matthew Brand, Diego Romeres, Toshiaki Koike-Akino
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51200
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00182

Browse the full library · About the Tower of Babel