2D Gaussians Spatial Transport for Point-supervised Density Regression
Miao Shang, Xiaopeng Hong · 2025
Read 2D Gaussians Spatial Transport for Point-supervised Density Regression by Miao Shang, Xiaopeng Hong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14477.txt.
Introduction
Miao Shang and Xiaopeng Hong introduce Gaussian Spatial Transport for tasks that need point based density maps. In crowd counting and landmark tasks, each label is just a point in an image. Models must turn those sparse points into a full density map. Standard transport methods are slow because they solve a costly plan at each training step.
Their method uses Gaussian splatting to link image pixels to label points. From that link they derive a transport plan with a probability based formula. A new loss then guides standard network training. Tests on crowd counting and landmark tasks show strong results with much better training speed.
Catalog record
| CREATOR | Miao Shang, Xiaopeng Hong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14477
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
2D Gaussians Spatial Transport for Point-supervised Density Regression Miao Shang, Xiaopeng Hong Abstract This paper introduces Gaussian Spatial Transport (GST), a novel framework that leverages Gaussian splatting to facilitate transport from the probability measure in the image coordinate space to the annotation map. We propose a Gaussian splatting-based method to estimate pixel-annotation correspondence, which is then used to compute a transport plan derived from Bayesian probability. To integrate the resulting transport plan into standard network optimization in typical computer vision tasks, we derive a loss function that measures discrepancy after transport. Extensive experiments on representative computer vision tasks, including crowd counting and landmark detection, validate the effectiveness of our approach. Compared to conventional optimal transport schemes, GST eliminates iterative transport plan computation during training, significantly improving efficiency. Code is available at https://github.com/infinite0522/GST . Introduction Optimal transport (OT) has gained great attention in computer vision due to its powerful ability to model and solve various problems involving distances and distributions ( 23 ; 31 ; 34 ; 18 ; 38 ; 6 ) . By treating the prediction and the ground truth as probability distributions, OT determines their optimal match with the transport cost measured by, for example, the Wasserstein distance ( 10 ) . However, despite their effectiveness, the application of OT in deep learning is plagued by high computational costs. This issue stems from their inherent bi-level optimization nature: at each training iteration, an inner loop must solve a costly OT problem (e.g., via the Sinkhorn algorithm ( 4 ) ) to compute the loss, before an outer loop can update the network’s parameters. This tight coupling makes the entire optimization process extremely time-consuming. To address the computational bottleneck, the primary idea of this paper is to decouple the transport plan generation from the network optimization. The goal is to pre-compute a fixed transport pattern based on the input image and its annotations, and then use it throughout the training. However, this seemingly simple idea poses significant challenges. First, standard Optimal Transport lacks a mechanism to derive a transport plan from the input image prior to network optimization. OT treats the estimated density maps as probability measures in the image coordinate space and solves for the optimal plan to the annotation space. As a result, it requires the network to first generate the density map, followed by the computation of the transport plan and cost. Second, in practical applications such as crowd counting, the images often contain thousands of targets. To minimize annotation costs, only object locations are typically provided without detailed contours ( 1 ; 20 ; 17 ) . However, object contours are crucial for determining the correspondence between pixels and annotation points, which directly impacts the transport plan. Without contour information, accurately establishing pixel-to-object correspondence becomes challenging. In response to these challenges, we propose Gaussian Spatial Transport (GST), a novel framework that efficiently transports probability measures from image coordinates to annotation space. At its core, GST establishes an interpretable probabilistic correspondence between pixels and annotations by leveraging 2D Gaussian Splatting. This correspondence is then distilled into a fixed transport kernel, a matrix that encodes the static mapping from each pixel to all target annotations, which can be pre-computed before training. During optimization, the model’s predicted density map is pushed forward to the space of ground truth annotations via a single matrix multiplication with this pre-computed kernel. Whereas OT-based methods require iteratively solving a costly optimization problem to determine the transport plan and compute the loss, our loss is simply the discrepancy between the transported density and the ground truth. Extensive experiments demonstrate that GST achieves a strong balance of high accuracy and computational efficiency. The main contributions of this paper are threefold: Figure 1: Comparison of loss computing of Direct Regression, OT, and the proposed GST. • We propose a novel spatial transport framework that decouples plan generation from network optimization. It relies on a pre-computed transport kernel, which transforms the costly iterative optimization of OT into a single, efficient matrix multiplication during training. • We bridge Gaussian splatting and spatial transport by deriving a Bayesian framework to compute the transport kernel using results obtained from 2D Gaussian splatting. • We successfully apply the proposed GST framework to representative computer vision tasks, including crowd counting and landmark detection. Related work Spatial Transport Conventional point-supervised density regression methods ( 27 ; 12 ; 30 ) rely on handcrafted Gaussian kernels to generate pseudo-ground-truth density maps for direct pixel-to-pixel regression, creating a critical dependency on the quality of these synthetic approximations, as in Fig. 1 (a). Although subsequent improvements ( 40 ; 9 ; 33 ) introduce adaptive kernels to enhance quality, they still suffer from inherent localization ambiguity in high-density scenarios. Recent works ( 34 ; 24 ) mitigate these limitations by reframing the task as distribution matching via transport theory. These methods, based on Optimal Transport, treat the predicted density map and the ground truth as two measures, and define the training loss through the minimal cost to transport one to the other. For instance, DMCount ( 34 ) first introduced this using balanced OT, while subsequent works explored unbalanced OT to relax the strict mass conservation constraint ( 22 ; 14 ; 32 ) . However, it introduces a significant computational bottleneck due to its inherent bi-level optimization nature: at each training step, an inner-loop optimization (e.g., using the Sinkhorn algorithm) must be solved to find the optimal transport plan, before the outer-loop can update the network’s parameters. This iterative re-computation of the transport plan makes the entire process time-consuming. Through Bayesian Loss ( 21 ) avoids this cost by using a fixed, handcrafted transport plan, the reliance on a task-specific prior limits its adaptability. Our work addresses the limitations of both. We propose a novel transport scheme, which decouples the transport plan from the network optimization. Instead of using a handcrafted prior, we pre-compute a transport kernel by analyzing the input image’s content via Gaussian Splatting. During training, the transport is reduced to a single, efficient matrix multiplication, enabling high performance with significant computational gains. Fig. 1 illustrates the key differences between our method and other major paradigms like direct regression and OT. Gaussian Splatting Gaussian splatting (GS) is widely used for efficient appearance modeling and rendering. It approximates complex textures and colors of 3D scenes with overlapping Gaussian balls. Benefiting from the explicit differentiable rendering and GPU-parallelized, tiles-based rasterization pipeline, GS has become a new paradigm for fast differentiable rendering, making it a popular choice for real-time 3D scene reconstruction and editing ( 11 ; 8 ) . Recently, GS’s application has expanded to 2D tasks like image reconstruction ( 41 ; 5 ; 37 ) , compression ( 39 ; 35 ) , and super-resolution ( 7 ; 2 ) . In the 2D image domain, Gaussian units can serve as novel representation units, replacing traditional pixels. For instance, GaussianImage ( 39 ) innovatively replaces pixels with Gaussian units for image representation, further enhancing efficiency by simplifying the parameterization of Gaussian representations and the computationally intensive \alpha -blending process in 2D scenes. Existing methods primarily utilize 2D GS for image reconstruction and restoration. Instead, our work pioneers a novel application of Gaussian