Contour Information Aware 2D Gaussian Splatting for Image Representation

Masaya Takabe, Hiroshi Watanabe, Sujun Hong, Tomohiro Ikai, Zheming Fan, Ryo Ishimoto, Kakeru Sugimoto, Ruri Imichi · 2025

Read Contour Information Aware 2D Gaussian Splatting for Image Representation by Masaya Takabe, Hiroshi Watanabe, Sujun Hong, Tomohiro Ikai, Zheming Fan, Ryo Ishimoto, Kakeru Sugimoto, Ruri Imichi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23255.txt.

Introduction

Masaya Takabe and co-authors improve a lightweight way of storing images: representing a picture as a sum of two-dimensional Gaussian blobs. Two-dimensional Gaussian splatting compresses well and decodes in real time, but with few Gaussians the reconstructions blur object boundaries, because nothing tells the blobs where edges are. Their framework feeds contour information into the representation from the start.

Segmentation priors divide the image into object regions. During rasterization each Gaussian is confined to its own region. That stops colors from bleeding across boundaries and keeps edges crisp even under heavy compression. A warm-up scheme steadies the early training and improves convergence. On synthetic color charts and the DAVIS video dataset, the method reconstructed edges more faithfully than existing two-dimensional splatting approaches, with the clearest gains when the Gaussian count was very small. Rendering stays fast and memory use stays low throughout.

Catalog record

CREATORMasaya Takabe, Hiroshi Watanabe, Sujun Hong, Tomohiro Ikai, Zheming Fan, Ryo Ishimoto, Kakeru Sugimoto, Ruri Imichi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23255

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Contour Information Aware 2D Gaussian Splatting for Image Representation Masaya Takabe, Hiroshi Watanabe, Sujun Hong, Tomohiro Ikai, Zheming Fan, Ryo Ishimoto, Kakeru Sugimoto, Ruri Imichi Abstract Image representation is a fundamental task in computer vision. Recently, Gaussian Splatting has emerged as an efficient representation framework, and its extension to 2D image representation enables lightweight, yet expressive modeling of visual content. While recent 2D Gaussian Splatting (2DGS) approaches provide compact storage and real-time decoding, they often produce blurry or indistinct boundaries when the number of Gaussians is small due to the lack of contour awareness. In this work, we propose a Contour Information-Aware 2D Gaussian Splatting framework that incorporates object segmentation priors into Gaussian-based image representation. By constraining each Gaussian to a specific segmentation region during rasterization, our method prevents cross-boundary blending and preserves edge structures under high compression. We also introduce a warm-up scheme to stabilize training and improve convergence. Experiments on synthetic color charts and the DAVIS dataset demonstrate that our approach achieves higher reconstruction quality around object edges compared to existing 2DGS methods. The improvement is particularly evident in scenarios with very few Gaussians, while our method still maintains fast rendering and low memory usage. Fig. 1: Overview of the proposed method. Top: The pipeline of our framework. In addition to the conventional 2DGS pipeline, we feed the target image (to be represented with 2D Gaussians) into a segmentation model to obtain object-wise segmentation masks. These masks are integrated into the Gaussian Rasterizer as Object Domain Information. Bottom: Details inside the Gaussian Rasterizer. Each segmentation mask is represented using only the 2D Gaussians that fall within its region. I Introduction Image representation has long been a central problem in computer vision and graphics. With the rise of deep learning, Implicit Neural Representations (INRs) have emerged as a powerful paradigm for encoding images and scenes in a continuous and compact manner. By parameterizing visual signals with neural networks, INRs enable resolution-independent rendering and flexible content representation. However, INR-based methods often rely on large multilayer perceptrons (MLPs) or high-dimensional feature grids, which result in heavy memory usage and slow inference, limiting their practicality for interactive or resource-constrained applications. To address these challenges, recent research has explored alternatives based on Gaussian Splatting. In particular, 2D Gaussian Splatting (2DGS) methods such as Image-GS [ 21 ] and GaussianImage [ 20 ] represent images with adaptive sets of Gaussian primitives, achieving compact storage and real-time decoding while retaining competitive visual quality. These methods completely avoid large networks, making them highly efficient and interpretable compared to traditional INRs. Despite their advantages, existing 2DGS techniques struggle in scenarios with extreme compression, i.e., when only a very limited number of Gaussians are available. Under such conditions, object boundaries often become blurry or indistinct because there is a lack of explicit incorporation of structural and contour information to guide Gaussian placement and blending. To overcome this limitation, we propose a novel image representation framework that incorporates contour priors into 2DGS. Our method leverages segmentation masks obtained from pre-trained models such as SAM to assign region-based constraints to each Gaussian during training and rendering. Specifically, we associate each Gaussian with a segmentation region and restrict its contribution to pixels within that region, thereby preserving structural consistency. This design enables more accurate reconstruction around object boundaries, even under a limited Gaussian budget with very few Gaussians. Through experiments on synthetic and real-world images, we demonstrate that the proposed method achieves higher reconstruction quality, particularly around edges, compared to conventional 2DGS under the same Gaussian budget. Furthermore, our approach remains compatible with standard 2DGS rasterizers and retains the advantages of fast rendering speed and low memory footprint. Our contributions are summarized as follows: • We propose a contour-aware 2D Gaussian Splatting framework for efficient image representation, which improves edge fidelity under a limited Gaussian budget. • We introduce a region-constrained rasterization strategy with a warm-up scheme to enforce contour consistency and stabilize training. • We validate our method on synthetic color charts and real-world images, demonstrating superior reconstruction performance while retaining fast rendering and low memory usage. II Related Work II-A Implicit Neural Representation Implicit Neural Representations (INRs) have become a versatile tool for encoding visual and signal data, enabling continuous and compact parameterizations across diverse domains. With the advent of deep learning, INRs have been widely applied to diverse tasks such as 3D scene representation [ 11 , 15 ] , 2D image representation [ 17 , 5 ] and video representation [ 3 ] , super-resolution [ 4 ] , and compression [ 6 ] . A common class of INR methods relies on multilayer perceptrons (MLP) to map input spatial coordinates to color values, often using positional encodings [ 17 ] or periodic activation functions [ 15 ] to improve high-frequency detail modeling. Although these approaches achieve impressive reconstruction quality, they typically suffer from long training times, high GPU memory consumption, and slow decoding speeds, especially when applied to high-resolution content. To address these issues, more efficient variants have been proposed. However, even optimized methods remain computationally demanding for real-time or resource-constrained scenarios due to heavy memory access and limited content adaptivity. In contrast, our work explores an alternative framework that eliminates the reliance on large MLPs, instead leveraging 2DGS for fast, efficient, and interpretable image encoding. II-B Gaussian Splatting for Visual Representation Gaussian Splatting has recently emerged as a highly efficient and expressive method for 3D scene representation [ 7 ] , and has been extended to segmentation [ 23 , 2 ] , dynamic scenes [ 10 , 16 ] , and generative modeling [ 22 , 19 ] . Encouraged by its success in 3D vision, recent works have begun adapting Gaussian Splatting to 2D image representation. Recent works have explored Gaussian Splatting as a lightweight alternative for image representation. In this framework, an image I(x,y) is approximated by a weighted sum of 2D anisotropic Gaussians: I(x,y)=\sum_{i=1}^{N}\alpha_{i}\cdot\mathcal{N}\!\left((x,y);\mu_{i},\Sigma_{i}\right)\cdot\mathbf{c}_{i}, (1) where each Gaussian primitive is parameterized by its center \mu_{i} , covariance \Sigma_{i} , opacity \alpha_{i} , and color \mathbf{c}_{i} . Unlike 3D Gaussian Splatting [ 7 ] , which requires depth-sorted \alpha -blending, 2DGS does not involve ordering along the depth dimension and therefore adopts this additive formulation as standard practice [ 20 , 21 ] . Building on this idea, Image-GS [ 21 ] places Gaussians according to image gradient magnitudes, assigning more primitives to high-frequency regions such as edges and textures. GaussianImage [ 20 ] instead proposes a fixed view 2DGS framework and introduces a rasterizer that accumulates Gaussian contributions through summation, rather than traditional alpha blending. Beyond static images, several works have also begun extending 2DGS to video representation [ 18 ] , demonstrating its potential for efficient spatio-temporal encoding. These approaches highlight that 2DGS offers compact storage and efficient rendering competitive with neural implicit representations. However, existing methods struggle to preserve sharp contours under extreme compression, where the number of Gaussians is severely limited. Our work builds upon this foundation by introducing contour-aware masking and Gaussian region control during rendering. This improves edge fidelity without sacrificing compression performance, bridging the gap between semantic structure preservation and efficient image encoding. Fig. 2: Quantitative results on the synthetic color charts. From left to

Read the complete text