GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens
Roni Itkin, Noam Issachar, Yehonatan Keypur, Xingyu Chen, Anpei Chen, Sagie Benaim · 2026
Read GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens by Roni Itkin, Noam Issachar, Yehonatan Keypur, Xingyu Chen, Anpei Chen, Sagie Benaim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15284.txt.
Introduction
Itkin and five colleagues build GlobalSplat, a feed-forward method for rebuilding 3D scenes from photos with Gaussian splatting, a technique that renders scenes from soft 3D blobs. Instead of piling up pixel-aligned blobs, it first aligns views into one compact global code, then decodes geometry. On two benchmarks it matches rivals using only 16,000 Gaussians and a 4MB model, rendering in under 78 milliseconds.
Catalog record
| CREATOR | Roni Itkin, Noam Issachar, Yehonatan Keypur, Xingyu Chen, Anpei Chen, Sagie Benaim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59157 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15284
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens Roni Itkin, Noam Issachar, Yehonatan Keypur, Xingyu Chen, Anpei Chen, Sagie Benaim Abstract The efficient spatial allocation of primitives serves as the foundation of 3D Gaussian Splatting, as it directly dictates the synergy between representation compactness, reconstruction speed, and rendering fidelity. Previous solutions, whether based on iterative optimization or feed-forward inference, suffer from significant trade-offs between these goals, mainly due to the reliance on local, heuristic-driven allocation strategies that lack global scene awareness. Specifically, current feed-forward methods are largely pixel-aligned or voxel-aligned. By unprojecting pixels into dense, view-aligned primitives, they bake redundancy into the 3D asset. As more input views are added, the representation size increases and global consistency becomes fragile. To this end, we introduce GlobalSplat, a framework built on the principle of align first, decode later . Our approach learns a compact, global, latent scene representation that encodes multi-view input and resolves cross-view correspondences before decoding any explicit 3D geometry. Crucially, this formulation enables compact, globally consistent reconstructions without relying on pretrained pixel-prediction backbones or reusing latent features from dense baselines. Utilizing a coarse-to-fine training curriculum that gradually increases decoded capacity, GlobalSplat natively prevents representation bloat. On RealEstate10K and ACID, our model achieves competitive novel-view synthesis performance while utilizing as few as 16K Gaussians, significantly less than required by dense pipelines, obtaining a light 4MB footprint. Further, GlobalSplat enables significantly faster inference than the baselines, operating under 78 milliseconds in a single forward pass. Project page is available at https://r-itk.github.io/globalsplat/ . 1 Introduction The efficient spatial allocation of primitives serves as the foundation of 3D Gaussian Splatting (3DGS), directly dictating the synergy between representation compactness, reconstruction speed, and rendering fidelity. We tackle this allocation challenge within the setting of feed-forward novel view synthesis (NVS). We aim to generate a highly compact set of 3D Gaussians from multiple input views in a single network pass, utilizing a fast and lightweight architecture. Crucially, as the number of input views increases to provide broader scene coverage, the network must effectively consolidate this multi-view information simultaneously. It must do so while maintaining a strictly compact 3D representation, utilizing a constant number of scene tokens, independent of the input size. Baseline Per-Pixel Approaches GlobalSplat (Ours) Figure 1 : Align First, Decode Later. Top: Existing feed-forward 3D Gaussian Splatting pipelines rely on view-centric, per-pixel primitive allocation. As the number of input views increases, these approaches bake massive redundancy into the 3D representation, scaling to hundreds of thousands or millions of Gaussians. In contrast, GlobalSplat aggregates multi-view inputs into a fixed set of global latent scene tokens before decoding geometry. This achieves an optimal balance: for instance, for 24 input views on RealEstate10K, GlobalSplat delivers highly competitive novel-view synthesis quality (28.5 PSNR), utilizing only 16K Gaussians and offering ultra-low GPU memory usage (1.79 GB), minimal disk size ( < 4 MB), and extremely fast inference times ( < 78 ms). Bottom Right: This scene-centric approach translates to a significantly stronger practical operating point in comparison to state-of-the art approaches, as demonstrated in the radar chart (evaluated on 24 input views on RealEstate10K). Bottom Left: By decoding from a global scene context (without a fixed grid), GlobalSplat stays sparse and places primitives at occupied 3D locations. This yields an adaptive allocation where low-frequency regions are covered by fewer Gaussians with larger spatial support (higher coverage), enabling complex scenes with far fewer primitives. We visualize the Gaussians as disks corresponding to their scale, as well as the Gaussian centers using a point cloud. As can be seen, this allows the model to effectively capture complex environments with drastically fewer primitives. Recently, feed-forward 3DGS approaches [ 4 , 41 , 7 , 33 , 11 , 38 , 19 , 42 , 2 , 31 , 30 , 24 , 1 ] have made strong progress on generalizable NVS by predicting explicit Gaussian scene representations directly from input views. This is a compelling direction because, once predicted, the output 3DGS asset can be rendered efficiently to target novel views without additional per-scene optimization or per-view generation as in diffusion-based video generation methods. However, most existing feed-forward 3DGS pipelines decode scene primitives from dense, view-aligned intermediates (e.g., pixel-aligned predictions, lifted per-view depth/features, or voxel-aligned outputs), attempting to reconcile them globally only afterward. This design ties primitive formation to hand-crafted local image or grid structures rather than the scene’s intrinsic global structure, and pushes global consistency to a late stage. Consequently, as the number of input views grows, the model must merge increasingly many view-anchored predictions. This inherently bakes redundancy into the representation and makes large-context reconstruction harder to scale robustly. In practice, this leads to an unfavorable trade-off: adding more views improves scene coverage, but simultaneously inflates the representation size and makes reconstruction quality less stable across regions of dense overlap, as illustrated in the top row of Fig. 1 . Our work, GlobalSplat, operates on an opposite appraoch: align first, decode later , as illustrated in the second row of Fig. 1 . Specifically, instead of forming Gaussians from per-view dense outputs, GlobalSplat first fuses all input views into a globally aligned latent scene representation, and only then decodes an explicit set of 3D Gaussians. This shifts reconstruction from view-centric primitive formation to scene-centric primitive formation. As a result, primitive allocation is driven by scene structure rather than image-grid support, enabling more efficient Gaussian placement while improving global coherence. The output remains a standard explicit 3DGS representation, preserving the rendering and deployment benefits of Gaussian splatting. To achieve this, GlobalSplat employs a dual-branch iterative attention architecture that disentangles geometry and appearance, fusing features from all input views into a fixed number of latent scene tokens. A specialized decoder then transforms these globally-aware tokens into explicit 3D Gaussians. By integrating a coarse-to-fine capacity curriculum during training, we naturally prevent the representation from bloating. We evaluate GlobalSplat on RealEstate10K and ACID in large-context settings (e.g., 16–36 input views) against strong feed-forward 3DGS baselines. Our results demonstrate a significantly stronger practical operating point for feed-forward reconstruction. GlobalSplat maintains a strict, view-invariant budget of 16K Gaussians (and occupying only 4 MB), regardless of the number of input views. It achieves highly competitive novel-view synthesis quality (e.g., 28.5 PSNR for 24 views on RealEstate10K) while utilizing a fraction of the GPU memory during inference (1.79 GB peak memory) and encoding scenes in just under 78 ms. To summarize, we provide the following contributions: • We identify a key limitation of current feed-forward 3DGS pipelines in large-context settings: primitives are typically formed in dense view-aligned spaces and only aligned globally afterward. This initial view-centric primitive formation produces an excessive number of Gaussians, which becomes the primary scalability bottleneck as more views are added. • We propose GlobalSplat, a feed-forward 3DGS framework that first builds a globally aligned latent scene representation and then decodes explicit 3D Gaussians ( Align First, Decode Later ). • We demonstrate that this yields a significantly stronger operating point for feed-forward reconstruction. By maintaining an ultra-compact 2K-32K Gaussian representation ( < 4 MB), GlobalSplat reduces the number of primitives by over 99% compared to dense baselines. Furthermore, it requires only 1.79 GB of peak GPU memory and generates scenes in