Learning to Drive from a World Model

Mitchell Goff, Greg Hogan, George Hotz, Armand du Parc Locmaria, Kacper Raczy, Adeeb Shihadeh, Weixing Zhang, Yassine Yousfi · 2025

Read Learning to Drive from a World Model by Mitchell Goff, Greg Hogan, George Hotz, Armand du Parc Locmaria, Kacper Raczy, Adeeb Shihadeh, Weixing Zhang, Yassine Yousfi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19077.txt.

Description

Most self-driving stacks rest on hand-coded sight outputs and hand-built driving rules. Mitchell Goff and co-authors test a leaner path in 2025: learn to drive straight from human driving data. Their setup trains a driving policy inside a simulator that runs the policy as it learns. Two kinds of simulation are compared side by side.

One method reprojects real sensor data to fake new views. The other uses a learned world model that dreams the road ahead. Both routes taught policies that drive with no hand-coded rules at all. The policies were judged in closed-loop simulation runs. They were also placed in a real driver-assist system on the road. The work shows end-to-end learning can scale with data and compute.

Catalog record

CREATORMitchell Goff, Greg Hogan, George Hotz, Armand du Parc Locmaria, Kacper Raczy, Adeeb Shihadeh, Weixing Zhang, Yassine Yousfi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19077

Browse the full library · About the Tower of Babel