Now You See That: Learning End-to-End Humanoid Locomotion from Raw Pixels
Wandong Sun 1,2 Yongbo Su 1,2 Leoric Huang 2 Alex Zhang 2 Dwyane Wei 2 Mu San 2 Daniel Tian 2 Ellie Cao 2 Finn Yan 2 Ethan Xie 2 Zongwu Xie 1 · 2026
Read Now You See That: Learning End-to-End Humanoid Locomotion from Raw Pixels by Wandong Sun 1,2 Yongbo Su 1,2 Leoric Huang 2 Alex Zhang 2 Dwyane Wei 2 Mu San 2 Daniel Tian 2 Ellie Cao 2 Finn Yan 2 Ethan Xie 2 Zongwu Xie 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06382.txt.
Description
A humanoid robot that walks by camera alone must survive noisy depth images and wildly different ground. Wandong Sun and 12 co-authors present an end-to-end learning framework for exactly that job. Simulated training usually transfers poorly, because real depth sensors leave artifacts that simulators omit.
Their depth simulator reproduces stereo matching flaws and calibration errors. A distillation step then transfers skill from clean height maps to the noisy depth view, guided by tasks that ignore noise. Separate reward shaping and paired critic and discriminator networks handle each terrain's distinct dynamics. Policies ran on two real humanoid platforms with different cameras, crossing harsh terrain while keeping the distinct motion style each surface demands.
Catalog record
| CREATOR | Wandong Sun 1,2 Yongbo Su 1,2 Leoric Huang 2 Alex Zhang 2 Dwyane Wei 2 Mu San 2 Daniel Tian 2 Ellie Cao 2 Finn Yan 2 Ethan Xie 2 Zongwu Xie 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06382