π 3 \pi^{3} : Scalable P ermutation-Equ i variant Visual Geometry Learning

Yifan Wang, Jianjun Zhou, Haoyi Zhu, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Jiangmiao Pang, Chunhua Shen, Tong He · 2025

Read π 3 \pi^{3} : Scalable P ermutation-Equ i variant Visual Geometry Learning by Yifan Wang, Jianjun Zhou, Haoyi Zhu, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Jiangmiao Pang, Chunhua Shen, Tong He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13347.txt.

Introduction

Yifan Wang and co-authors rebuild 3D scenes from photos without crowning any one photo as the reference. Earlier feed-forward reconstructors anchor everything to a chosen viewpoint, and a bad anchor wobbles the whole result. Their 2025 network, named pi-cubed, is permutation-equivariant: shuffle the input images and the answer shuffles to match, nothing privileged.

From the image set it predicts each camera's pose in a form indifferent to the scene's overall placement, plus per-view point maps that ignore global scale. Across camera pose estimation, depth estimation from one or many frames, and dense point mapping, the design reached state-of-the-art results. The authors credit the symmetry itself: removing the reference bias removed a failure mode. Code and models are public, an invitation to build on the bias-free recipe.

Catalog record

CREATORYifan Wang, Jianjun Zhou, Haoyi Zhu, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Jiangmiao Pang, Chunhua Shen, Tong He
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13347

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

π 3 \pi^{3} : Scalable P ermutation-Equ i variant Visual Geometry Learning Yifan Wang, Jianjun Zhou, Haoyi Zhu, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Jiangmiao Pang, Chunhua Shen, Tong He Abstract We introduce π 3 \pi^{3} , a feed-forward neural network that offers a novel approach to visual geometry reconstruction, breaking the reliance on a conventional fixed reference view. Previous methods often anchor their reconstructions to a designated viewpoint, an inductive bias that can lead to instability and failures if the reference is suboptimal. In contrast, π 3 \pi^{3} employs a fully permutation-equivariant architecture to predict affine-invariant camera poses and scale-invariant local point maps without any reference frames. This design makes our model inherently robust to input ordering and highly scalable. These advantages enable our simple and bias-free approach to achieve state-of-the-art performance on a wide range of tasks, including camera pose estimation, monocular/video depth estimation, and dense point map reconstruction. Code and models are publicly available. Figure 1 : \pi^{3} effectively reconstructs a diverse set of open-domain images in a feed-forward manner, encompassing various scenes such as indoor, outdoor, and aerial-view, as well as cartoons, with both dynamic and static content. 1 Introduction “Learning always beats inductive biases.” — Jonathan T. Barron, Radiance Fields and the Future of Generative Media Visual geometry reconstruction, a long-standing and fundamental problem in computer vision, holds substantial potential for applications such as augmented reality Engel et al. 2023 , robotics Zhu et al. 2024 , and autonomous navigation Mur-Artal et al. 2015 . While traditional methods addressed this challenge using iterative optimization techniques like Bundle Adjustment (BA) Hartley and Zisserman 2003 , the field has recently seen remarkable progress with feed-forward neural networks. End-to-end models like DUSt3R Wang et al. 2024 and its successors have demonstrated the power of deep learning for reconstructing geometry from image pairs Leroy et al. 2024 ; Zhang et al. 2024 , videos, or multi-view collections Yang et al. 2025 ; Zhang et al. 2025 ; Wang et al. 2025a . Figure 2 : \pi^{3} demonstrates significant convergence acceleration (a) and enhanced scalability (b) compared to its non-equivariant counterpart. PI denotes the P ermutation-Equ I variant property. Despite these advances, a critical limitation persists in both classical and modern approaches: the reliance on selecting a single, fixed reference view. The camera coordinate system of this chosen view is treated as the global frame of reference, a practice inherited from traditional Structure-from-Motion (SfM) Hartley and Zisserman 2003 ; Cui et al. 2017 ; Schonberger and Frahm 2016 ; Pan et al. 2024 or Multi-view Stereo (MVS) Furukawa et al. 2015 ; Schönberger et al. 2016 . We contend that this design choice introduces an unnecessary inductive bias that fundamentally constrains the performance and robustness of feed-forward neural networks. As we demonstrate empirically, this reliance on an arbitrary reference makes existing methods, including the state-of-the-art (SOTA) VGGT Wang et al. 2025a , highly sensitive to the initial view selection. A poor choice can lead to a dramatic degradation in reconstruction quality, hindering the development of robust and scalable systems (Fig. 3 ). To overcome this limitation, we introduce \pi^{3} , a robust, scalable, and fully permutation-equivariant method that eliminates reference view-based biases in visual geometry learning. \pi^{3} accepts varied inputs—including single images, video sequences, or unordered image sets from static or dynamic scenes—without designating a reference view. Instead, our model predicts an affine-invariant camera pose and a scale-invariant local pointmap for each frame, all relative to that frame’s own camera coordinate system. By eschewing order-dependent components like frame index positional embeddings and employing a transformer architecture that alternates between view-wise and global self-attention (similar to Wang et al. 2025a ), \pi^{3} achieves true permutation equivariance. This guarantees a consistent one-to-one mapping between visual inputs and the reconstructed geometry, making the model inherently robust to input order and immune to the reference view selection problem. Figure 3 : Performance comparison across different reference frames. While previous methods, even with DINO-based selection, show inconsistent results, \pi^{3} consistently delivers superior and stable performance, demonstrating its robustness. Our design yields significant advantages. First, it demonstrates remarkable scalability, with performance consistently improving as the model size increases (Fig. 2 and Fig. 9 ). Second, it achieves significantly faster training convergence (Fig. 2 and Fig. 9 ). Finally, our model is substantially more robust; in contrast to previous methods, it shows minimal performance degradation and low standard deviation when the reference frame is changed (Fig. 3 and Table 7 ). Through extensive experiments, \pi^{3} establishes a new SOTA across numerous benchmarks and tasks. For example, it achieves comparable performance to existing methods like MoGe Wang et al. 2025c in monocular depth estimation, and outperforms VGGT Wang et al. 2025a in video depth estimation and camera pose estimation. On the Sintel benchmark, \pi^{3} reduces the camera pose estimation ATE from VGGT’s 0.167 down to 0.074 and improves the scale-aligned video depth absolute relative error from 0.299 to 0.233. Furthermore, \pi^{3} is both lightweight and fast, achieving an inference speed of 57.4 FPS compared to DUSt3R’s 1.25 FPS and VGGT’s 43.2 FPS. Its ability to reconstruct both static and dynamic scenes makes it a robust and optimal solution for real-world applications. In summary, the contributions of this work are as follows: • We are the first to systematically identify and challenge the reliance on a fixed reference view in visual geometry reconstruction, demonstrating how this common design choice introduces a detrimental inductive bias that limits model robustness and performance. • We propose \pi^{3} , a novel, fully permutation-equivariant architecture that eliminates this bias. Our model predicts affine-invariant camera poses and scale-invariant pointmaps in a purely relative, per-view manner, completely removing the need for a global coordinate system. • We demonstrate through extensive experiments that \pi^{3} establishes a new state-of-the-art on a wide range of benchmarks for camera pose estimation, monocular/video depth estimation, and pointmap reconstruction, outperforming prior leading methods. • We show that our approach is not only substantially more robust to input view ordering and more scalable with model size, but also converges significantly faster during training. 2 Related Work 2.1 Traditional 3D Reconstruction Reconstructing 3D scenes from images is a foundational problem in computer vision. Classical methods, such as Structure-from-Motion (SfM) Hartley and Zisserman 2003 ; Cui et al. 2017 ; Schonberger and Frahm 2016 ; Pan et al. 2024 and Multi-View Stereo (MVS) Furukawa et al. 2015 ; Schönberger et al. 2016 , have achieved considerable success. These techniques leverage the principles of multi-view geometry to establish feature correspondences across images, from which they estimate camera poses and generate dense 3D point clouds. Although robust, particularly in controlled environments, these methods typically rely on complex, multi-stage pipelines. Moreover, they often involve time-consuming iterative optimization problems, such as Bundle Adjustment (BA), to jointly refine the 3D structure and camera poses. 2.2 Feed-Forward 3D Reconstruction Recently, feed-forward models have emerged as a powerful alternative, capable of directly regressing the 3D structure of a scene from a set of images in a single pass. Pioneering efforts in this domain, such as Dust3R Wang et al. 2024 , focused on processing image pairs to predict a point cloud within the coordinate system of the first camera. While

Read the complete text