Long-Tail Internet Photo Reconstruction
Yuan Li, Yuanbo Xiangli, Hadar Averbuch-Elor, Noah Snavely, Ruojin Cai · 2026
Read Long-Tail Internet Photo Reconstruction by Yuan Li, Yuanbo Xiangli, Hadar Averbuch-Elor, Noah Snavely, Ruojin Cai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22714.txt.
Introduction
Li, Xiangli, Averbuch-Elor, Snavely, and Cai tackle three-dimensional reconstruction of rarely photographed places, where sparse and uneven internet photos defeat standard methods. They build MegaDepth-X, a large set of clean reconstructions with dense depth, and simulate sparse scenes by sampling subsets from well-covered landmarks. Fine-tuning on this material yields sturdy reconstructions from very few views, including symmetric scenes.
Catalog record
| CREATOR | Yuan Li, Yuanbo Xiangli, Hadar Averbuch-Elor, Noah Snavely, Ruojin Cai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61831 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22714
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Long-Tail Internet Photo Reconstruction Yuan Li, Yuanbo Xiangli, Hadar Averbuch-Elor, Noah Snavely, Ruojin Cai Abstract Internet photo collections exhibit an extremely long-tailed distribution: a few famous landmarks are densely photographed and easily reconstructed in 3D, while most real-world sites are represented with sparse, noisy, uneven imagery beyond the capabilities of both classical and learned 3D methods. We believe that tackling this long-tail regime represents one of the next frontiers for 3D foundation models. Although reliable ground-truth 3D supervision from sparse scenes is challenging to acquire, we observe that it can be effectively simulated by sampling sparse subsets from well-reconstructed Internet landmarks. To this end, we introduce MegaDepth-X, a large dataset of 3D reconstructions with clean, dense depth, together with a strategy for sampling sets of training images that mimic camera distributions in long-tail scenes. Finetuning 3D foundation models with these components yields robust reconstructions under extreme sparsity, and also enables more reliable reconstruction in symmetric and repetitive scenes, while preserving generalization to standard, dense 3D benchmark datasets. The dataset, finetuned models, and code are available at: https://megadepth-x.github.io/ . Figure 1 : Long-tail Internet photo reconstruction. Internet photo collections follow a long-tailed distribution. In the top plot, the x -axis represents scene index (sorted by image count) and the y -axis shows images per scene (scenes are drawn from MegaScenes 36 , a dataset of Internet photo collections). The light blue curve plots the total number of Internet photos per scene, while the steel blue curve shows the size of the subset of photos that were successfully registered using SfM. The head of this distribution of photo collections represents well-photographed scenes; here, there are 6,985 scenes with > 50 registered images. However, most photo collections are in the long tail of this distribution; here, 418,056 scenes with fewer than 50 registered photos. State-of-the-art methods often fail on scenes in this tail. In the lower half of the figure, we show two examples from the long tail, along with representative input images and the corresponding reconstructions. On Calvaire de Plougonven, COLMAP doesn’t register any image; on both Duomo (Cagliari)-Crypt and Calvaire de Plougonven, recent feed-forward reconstruction models like \pi^{3} 43 produce poor results. We propose MegaDepth-X dataset and a strategy for mimicking long-tail camera distributions, on which fine-tuned models like \pi^{3} exhibit better reconstruction robustness. 2 2 footnotetext: Corresponding authors. 1 Introduction Internet photo collections of real-world landmarks follow a long-tailed distribution. A small fraction of famous sites, such as the Colosseum or Notre Dame, are photographed from every conceivable angle and can be accurately reconstructed by standard Structure-from-Motion (SfM) pipelines. Yet the overwhelming majority of landmarks across the world are represented on the Internet with just a handful of sparse, noisy images (Fig. 1 ). We refer to this large body of scenes as the long-tail of online photo collections. Such scenes are the norm rather than the exception in real-world Internet imagery. Reconstructing long-tail scenes is challenging. Classic methods, such as COLMAP 30 , often fail because feature correspondence is hard to find across sparse, non-overlapping, or wide-baseline views. Modern learned feed-forward models, like DUSt3R 41 and VGGT 39 , can learn powerful priors from millions of images that might help reconstruct long-tail collections. In practice, however, these models are primarily trained on controlled captures with clean, dense, and evenly sampled data. When applied to long-tail Internet scenes featuring sparse, diverse, and unevenly distributed imagery, we find that these models often fail to recover consistent geometry. We believe that one of the next frontiers for 3D foundation models lies in tackling this long-tail regime of Internet photos. Better data is almost certainly key to this problem, but we cannot easily construct reliable 3D supervision from long-tail collections themselves, as most contain too few overlapping views for robust reconstruction. Instead, we propose to simulate such long-tailed sets by appropriate sampling of sparse images from the large, well-reconstructed Internet landmarks at the head of the distribution, inheriting ground truth from the full reconstruction. This strategy requires drawing from large amounts of high-quality landmark reconstructions from Internet photos. Existing datasets fall short of this need: MegaDepth 20 is clean but small, while MegaScenes 36 is large but noisy and lacks depth maps. We therefore introduce MegaDepth-X (dubbed MD-X), a next-generation extension of MegaDepth in both scale ( 7\times larger) and quality: a large-scale, clean, and dense-depth-enhanced dataset built from Internet photo reconstructions with consistent depth refinement and extensive manual verification against reliable references (e.g., Google Maps and satellite imagery). Equipped with MD-X, we propose a novel sparsity-aware sampling strategy that mimics the camera distributions of long-tail scenes, encouraging training batches to span wide baselines and partial overlap rather than clustered dense views. Through extensive experiments, we show that models fine-tuned with MD-X and our sparsity-aware data sampling scheme are significantly more robust on long-tail Internet photo collections, including challenging doppelganger scenes with ambiguous or symmetric content, such as the Calvaire de Plougonven example in Fig. 1 , where classical SfM and pretrained foundation models often fail. In summary, our contributions are: • Defining the 3D long-tail regime : we formalize and characterize the long-tail distribution of Internet photo collections, highlighting this setting’s distinct challenges. • MegaDepth-X , dubbed MD-X, a large-scale, clean, and depth-augmented dataset for finetuning 3D foundation models on real-world Internet scenes. • Sparsity-aware sampling strategies that simulate the distribution of long-tail Internet collections to improve generalization of 3D prediction models on real-world data. 2 Related Work Feed-forward 3D reconstruction. Reconstructing 3D scene geometry from 2D images is a cornerstone of computer vision. Traditional structure from motion (SfM) 28 and multi-view stereo (MVS) 29 methods were crowning achievements of the classic era of 3D vision, and were scaled to large Internet photo collections 34 ; 1 ; 12 . Recently, the new paradigm of feed-forward 3D reconstruction has emerged, which involves regressing 3D attributes directly from images in a single pass. Pioneering work in this area, such as DUSt3R, showed success at predicting pixel-aligned point maps from image pairs 41 . MASt3R extended this approach but still relied on pairwise processing 19 . Subsequent efforts focused on scaling these models to arbitrary numbers of views. VGGT 39 , along with concurrent models like Fast3R 47 and FLARE 50 , introduced large transformer architectures that can process hundreds of views simultaneously. By leveraging large-scale, diverse datasets and a multi-task learning objective, VGGT predicts a full suite of 3D attributes, including camera parameters, depth maps, and point maps. To eliminate reference-frame bias, \pi^{3} 43 recently proposed a permutation-equivariant architecture that predicts affine-invariant camera poses and scale-invariant local point maps. ZipMap 16 and Scal3R 46 introduced test-time training approaches to process large image collections. These methods work well on densely-captured and well-conditioned scenes. However, we find that their performance on more sparse and noisy Internet photos remains suboptimal, particularly for long-tail scenes. Long-tail challenges in 3D vision. Long-tailed problems are pervasive in computer vision. They occur when data for common scenarios (the head) are abundant, but examples of rare yet collectively frequent cases (the tail) are scarce. For instance, many object recognition problems involve a few dominant categories but many rarely seen ones, and in autonomous driving, routine driving scenes are plentiful while safety-critical