SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarios
Tian Gao, Celine Tan, Catherine Glossop, Timothy Gao, Jiankai Sun, Kyle Stachowicz, Shirley Wu, Oier Mees, Dorsa Sadigh, Sergey Levine, Chelsea Finn · 2026
Read SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarios by Tian Gao, Celine Tan, Catherine Glossop, Timothy Gao, Jiankai Sun, Kyle Stachowicz, Shirley Wu, Oier Mees, Dorsa Sadigh, Sergey Levine, Chelsea Finn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08440.txt.
Description
Self-driving cars must reason about rare events in words while controlling the car in real time, a gap between thinking and acting. Tian Gao and ten co-authors propose SteerVLA, a system where a vision-language model steers a driving policy through fine-grained language instructions. Their arXiv paper targets long-tail scenarios where generic reasoning alone fails.
The key is a rich language interface that grounds high-level reasoning in the low-level policy's outputs. Detailed language annotations, generated with a vision-language model, prove essential for teaching steerability. On a closed-loop benchmark, SteerVLA beats the best prior methods by 4.77 points overall and 8.04 points on the long-tail subset. Readers get a concrete bridge between web-scale knowledge and safe driving.
Catalog record
| CREATOR | Tian Gao, Celine Tan, Catherine Glossop, Timothy Gao, Jiankai Sun, Kyle Stachowicz, Shirley Wu, Oier Mees, Dorsa Sadigh, Sergey Levine, Chelsea Finn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08440