Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video

Zihui Gao, Ke Liu, Donny Y. Chen, Duochao Shi, Guosheng Lin, Hao Chen, Chunhua Shen · 2026

Read Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video by Zihui Gao, Ke Liu, Donny Y. Chen, Duochao Shi, Guosheng Lin, Hao Chen, Chunhua Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07891.txt.

Description

Geometric foundation models promise strong 3D reconstruction, but they starve for diverse large-scale 3D annotations. Zihui Gao and seven co-authors turn to abundant internet video of static scenes, proposing SAGE, a framework that adapts geometric models from raw video without ground-truth geometry.

A hierarchical mining pipeline selects informative training trajectories, anchors global structure with sparse structure-from-motion point clouds, and enforces multi-view consistency through differentiable 3D Gaussian rendering. Replaying a small share of supervised data prevents forgetting. Applied to two different backbones, SAGE cuts Chamfer distance on unseen benchmarks. The work shows how the web's video flood can feed 3D learning despite noise and missing labels.

Catalog record

CREATORZihui Gao, Ke Liu, Donny Y. Chen, Duochao Shi, Guosheng Lin, Hao Chen, Chunhua Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07891

Browse the full library · About the Tower of Babel