Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video
Zihui Gao, Ke Liu, Donny Y. Chen, Duochao Shi, Guosheng Lin, Hao Chen, Chunhua Shen · 2026
Read Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video by Zihui Gao, Ke Liu, Donny Y. Chen, Duochao Shi, Guosheng Lin, Hao Chen, Chunhua Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07891.txt.
Description
Geometric foundation models promise strong 3D reconstruction, but they starve for diverse large-scale 3D annotations. Zihui Gao and seven co-authors turn to abundant internet video of static scenes, proposing SAGE, a framework that adapts geometric models from raw video without ground-truth geometry.
A hierarchical mining pipeline selects informative training trajectories, anchors global structure with sparse structure-from-motion point clouds, and enforces multi-view consistency through differentiable 3D Gaussian rendering. Replaying a small share of supervised data prevents forgetting. Applied to two different backbones, SAGE cuts Chamfer distance on unseen benchmarks. The work shows how the web's video flood can feed 3D learning despite noise and missing labels.
Catalog record
| CREATOR | Zihui Gao, Ke Liu, Donny Y. Chen, Duochao Shi, Guosheng Lin, Hao Chen, Chunhua Shen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07891