STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes

Jiawei Yang, Jiahui Huang, Yuxiao Chen, Yan Wang, Boyi Li, Yurong You, Maximilian Igl, Apoorva Sharma, Peter Karkus, Danfei Xu, Boris Ivanovic, Yue Wang, Marco Pavone · 2025

Read STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes by Jiawei Yang, Jiahui Huang, Yuxiao Chen, Yan Wang, Boyi Li, Yurong You, Maximilian Igl, Apoorva Sharma, Peter Karkus, Danfei Xu, Boris Ivanovic, Yue Wang, Marco Pavone (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00602.txt.

Description

Jiawei Yang and co-authors rebuild moving outdoor scenes in a paper published in 2024. Faithful three-dimensional reconstruction of dynamic streets normally needs dense views and per-scene tuning, which is slow and brittle. Their model instead predicts the scene in one forward pass with a transformer network.

It represents the scene as moving three-dimensional blobs with velocities, using self-supervised flow to gather blobs from all frames into any chosen moment. That yields complete views from arbitrary angles, and moving objects emerge with clean masks from reconstruction loss alone. The method beats prior approaches on public data, rebuilds a scene in a fifth of a second, and renders in real time.

Catalog record

CREATORJiawei Yang, Jiahui Huang, Yuxiao Chen, Yan Wang, Boyi Li, Yurong You, Maximilian Igl, Apoorva Sharma, Peter Karkus, Danfei Xu, Boris Ivanovic, Yue Wang, Marco Pavone
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-00602

Browse the full library · About the Tower of Babel