Language-Guided Transformer Tokenizer for Human Motion Generation

Sheng Yan, Yong Wang, Xin Du, Junsong Yuan, Mengyuan Liu, [2mm] Transsion Ltd · 2026

Read Language-Guided Transformer Tokenizer for Human Motion Generation by Sheng Yan, Yong Wang, Xin Du, Junsong Yuan, Mengyuan Liu, [2mm] Transsion Ltd (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08337.txt.

Description

Turning motion into discrete tokens lets generators work with compact codes, but more tokens mean harder learning. Sheng Yan and four co-authors propose LG-Tok, a tokenizer that uses language to guide motion coding, so a few high-level tokens carry the meaning of a movement. Their 2026 arXiv paper pairs that idea with a Transformer tokenizer whose attention can link words and motion across the whole sequence.

A language-drop trick during training also lets the decoder work without language at generation time. On two motion benchmarks the method tops prior work on both match accuracy and realism scores, and a mini version using half the tokens stays competitive. Readers get a neat trade: richer tokens, fewer of them, and easier learning for the generator downstream.

Catalog record

CREATORSheng Yan, Yong Wang, Xin Du, Junsong Yuan, Mengyuan Liu, [2mm] Transsion Ltd
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08337

Browse the full library · About the Tower of Babel