ActionCodec: What Makes for Good Action Tokenizers

Zibin Dong, Yicheng Liu, Shiduo Zhang, Baijun Ye, Yifu Yuan, Fei Ni, Jingjing Gong, Xipeng Qiu, Hang Zhao, Yinchuan Li, Jianye Hao · 2026

Read ActionCodec: What Makes for Good Action Tokenizers by Zibin Dong, Yicheng Liu, Shiduo Zhang, Baijun Ye, Yifu Yuan, Fei Ni, Jingjing Gong, Xipeng Qiu, Hang Zhao, Yinchuan Li, Jianye Hao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15397.txt.

Description

Dong and colleagues tackle coding in Vision-Language-Action models, which use the built-in self-feeding model of Vision-Language Models and show better task chasing. Key to this model is coding, yet its plan has aimed on rebuild truth, missing its effect on tuning. The puzzle of what makes good action coders stays open.

The team closes this gap by setting rules for VLA tuning. They name habits based on info ideas: maxed time token sharing, cut words overlap, multi-mode shared info, and token freedom. Led by these rules, they offer ActionCodec, a high-speed coder that lifts training speed and VLA speed across sim and real-world tests. On LIBERO, a SmolVLM2 2B fine-tuned with ActionCodec hits about 95 and a half percent wins without robotics pre-training. With design boosts, this hits about 97 percent, a new SOTA for VLA models without robotics pre-training.

Catalog record

CREATORZibin Dong, Yicheng Liu, Shiduo Zhang, Baijun Ye, Yifu Yuan, Fei Ni, Jingjing Gong, Xipeng Qiu, Hang Zhao, Yinchuan Li, Jianye Hao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-15397

Browse the full library · About the Tower of Babel