studentSplat :Your Student Model Learns Single-view 3D Gaussian Splatting

Yimu Pan, Hongda Mao, Qingshuang Chen, Yelin Kim · 2026

Read studentSplat :Your Student Model Learns Single-view 3D Gaussian Splatting by Yimu Pan, Hongda Mao, Qingshuang Chen, Yelin Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11772.txt.

Introduction

Yimu Pan, Hongda Mao, Qingshuang Chen, and Yelin Kim present a way to build a 3D scene from just one view. Past fast methods work well from many views for a scene, or from one view for a lone object. One view of a whole scene is much less clear, since depth is lost.

Their method, called studentSplat in the work, uses 3D Gaussian splatting. That is a way to store a scene as many soft 3D blobs. The name hints at a student model that learns the task. A good one-view method would help apps that have just a single photo to work from.

Catalog record

CREATORYimu Pan, Hongda Mao, Qingshuang Chen, Yelin Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11772

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

studentSplat :Your Student Model Learns Single-view 3D Gaussian Splatting Yimu Pan, Hongda Mao, Qingshuang Chen, Yelin Kim Abstract Recent advance in feed-forward 3D Gaussian splatting has enable remarkable multi-view 3D scene reconstruction or single-view 3D object reconstruction but single-view 3D scene reconstruction remain under-explored due to inherited ambiguity in single-view. We present studentSplat , a single-view 3D Gaussian splatting method for scene reconstruction. To overcome the scale ambiguity and extrapolation problems inherent in novel-view supervision from a single input, we introduce two techniques: 1) a teacher-student architecture where a multi-view teacher model provides geometric supervision to the single-view student during training, addressing scale ambiguity and encourage geometric validity; and 2) an extrapolation network that completes missing scene context, enabling high-quality extrapolation. Extensive experiments show studentSplat achieves state-of-the-art single-view novel-view reconstruction quality and comparable performance to multi-view methods at the scene level. Furthermore, studentSplat demonstrates competitive performance as a self-supervised single-view depth estimation method, highlighting its potential for general single-view 3D understanding tasks. Figure 1: What can you do with studentSplat ? All the results are generated using our studentSplat with teacher refine (detailed in the Appendix D ) with only one input image. The input to our studentSplat is highlighted in green. studentSplat directly takes the generated image from Stable Diffusion ( 40 ) in text-to-3D application. 1 Introduction 3D reconstruction is an essential task in robotics ( 61 ; 14 ) , navigation ( 9 ; 18 ) , virtual reality ( 2 ) , and content creation ( 17 ; 51 ) . Advances in deep learning have enabled remarkable progress in 3D reconstruction ( 48 ; 31 ; 54 ; 20 ) through per-scene optimization using a large number of views. Recently, efficient feed-forward methods ( 65 ; 5 ) have been proposed to take a sparse set of input views and construct the 3D reconstruction, greatly improving efficiency. However, these methods require not only multi-view input but also the corresponding camera poses. Obtaining accurate camera poses usually involves a time and computation-intensive pipeline ( 55 ) and a large number of camera views or additional specialized networks ( 19 ; 64 ; 36 ) , which hinders the efficiency of feed-forward sparse-view 3D reconstruction. Single-view 3D reconstruction relaxes the requirements on both multi-view input and camera poses, serving as a more generalized alternative. Due to the inherent ambiguity in single-view input, current single-view 3D reconstruction works ( 65 ; 50 ) only operate at the object level. In this work, we aim to expand single-view 3D object reconstruction to the scene level and propose a model capable of performing single-view 3D scene reconstruction using only multi-view supervision (i.e., no ground truth 3D annotations). In addition to the generalizability improvements from this extension, single-view 3D scene reconstruction holds the potential to perform self-supervised single-view vision tasks such as single-view depth estimation ( 23 ) and aid semantic segmentation ( 66 ; 45 ) . Finally, a single-view 3D scene reconstruction model can be applied to the results from a text-to-image generation model ( 40 ) to achieve text-to-3D scene generation without separate training. To enable single-view 3D reconstruction, we adopt the 3D Gaussian splatter (3DGS) ( 20 ) representation. We identify and address two main problems in single-view 3DGS: scale ambiguity and extrapolation. We tackle these problems by proposing studentSplat , a single-view 3DGS model at the scene level. Since the unknown scale can be inferred when at least two input views are provided but is impossible using one input view ( 5 ; 8 ) , our core design is to use a multi-view teacher model to estimate the 3D structure up to a scale and supervise the single-view student model using the teacher’s estimation. Moreover, unlike a multi-view model that can bound the novel views by the input view frustums, a single-view model is required to extrapolate due to occlusion and camera view changes, which can lead to distortion of the 3DGS. We propose an extrapolator to complete the missing context in renderings before computing the novel-view reconstruction loss, both performing extrapolation and minimizing distortion. Extensive experiments show that our method can achieve good 3DGS on different benchmarks. Additionally, our method has the potential to connect 3DGS to self-supervised single-view vision tasks by demonstrating comparable performance to a self-supervised single-view depth estimation method. Our contributions are summarized as follows: • Propose the a single-view 3D scene Gaussian splatting model that does not require relative camera poses during inference. • Address the extrapolation problem in single-view 3D scene reconstruction, which reduces distortion and produces out-of-context regions. • Bridge the gap between multi-view 3D Gaussian splatting and self-supervised single-view depth estimation, expanding the applications of 3D Gaussian splatting models. 2 Related Work 2.1 3D Representation Numerous 3D representations have been proposed to accommodate different applications. Point clouds are used in many applications ( 55 ; 46 ; 33 ) where the geometric shape is important. Recently, Neural Radiance Field (NeRF) ( 31 ) is proposed to learn a view-based rendering function from multi-view supervision, but this learned function does not directly represent the geometric shape. 3DGS ( 20 ) is an efficient alternative representation similar to point clouds. Additionally, the efficient differentiable rendering implementation of 3DGS enables direct optimization of point clouds (3D Gaussians). This representation allows us to connect novel-view reconstruction to geometric reconstruction in an end-to-end manner. 2.2 Feed-forward Multi-view 3D Reconstruction NeRF ( 31 ) is one of the most popular representations for multi-view 3D reconstruction. PixelNeRF ( 65 ) and GRF ( 53 ) were among the earlier works that used a feed-forward network to produce radiance fields. Subsequent approaches improved rendering performance by incorporating cross-view feature matching ( 6 ; 7 ; 10 ) , geometric encoding ( 32 ) , or target view information ( 60 ) . Different from the predefined NeRF function, SRT ( 43 ) used a transformer to represent the rendering function. Another line of work closely related to ours was initiated by pixelSplat ( 5 ) , which directly predicted 3D Gaussians from multi-view images. latentSplat ( 58 ) improved rendering performance by operating in the latent space, while MVSplat ( 8 ) incorporated cost-volume to improve both efficiency and performance. In contrast to previous approaches, our method requires only one input view, greatly improving the generalizability and versatility of the 3DGS model. Additionally, our method connects multi-view 3DGS to single-view vision tasks by learning one model that works on both tasks. 2.3 Feed-forward Single-view 3D Reconstruction Single-view 3D reconstruction usually works at the object level. Unlike their multi-view counterparts, single-view 3D reconstruction requires extrapolation. Therefore, generative methods like diffusion models ( 40 ; 26 ; 51 ; 27 ) are used to complete the reconstruction. Similar to multi-view 3D reconstruction, radiance fields are popular among the rendering methods ( 26 ; 38 ; 59 ; 52 ; 30 ; 25 ) . TARS ( 11 ) learns the deformation between 2D images and 3D objects. Recently, more approaches ( 50 ; 51 ) have started using 3DGS for 3D reconstruction. Many other approaches ( 33 ; 17 ) directly supervise the network using 3D object annotations. Additionally, some methods use learns directly from ground truth

Read the complete text