Learning to Adaptively Allocate Gaussians for Arbitrary-Scale Image Super-Resolution CCS: Computing methodologies Image representations CCS: Computing methodologies Reconstruction CCS: Computing methodologies Neural networks CCS: Computing methodologies Learning latent representations CCS: Computing methodologies Rasterization CCS: Computing methodologies Image processing CCS: Computing methodologies Point-based models
Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto · 2026
Read Learning to Adaptively Allocate Gaussians for Arbitrary-Scale Image Super-Resolution CCS: Computing methodologies Image representations CCS: Computing methodologies Reconstruction CCS: Computing methodologies Neural networks CCS: Computing methodologies Learning latent representations CCS: Computing methodologies Rasterization CCS: Computing methodologies Image processing CCS: Computing methodologies Point-based models by Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29400.txt.
Introduction
Federico and four colleagues address arbitrary-scale image super-resolution, where a small image must be enlarged by any factor, not just a fixed one. Most models train for one scale and then rely on plain interpolation for other sizes. They also spend equal effort on every pixel, meaning each picture dot, even though fine detail is sparse in most images.
Their model, QuADA-GS, places 2D Gaussian primitives, soft blobs that together form the picture, only where detail demands them. A neural routing part judges local complexity and hands out a global budget of primitives. A tool called Hierarchical Pointer Convolution lets features at uneven densities share information cheaply. The authors report state-of-the-art quality on perceptual fidelity, how natural the result looks. Latency stays low and memory use stays lean because the Gaussian count grows only where the image needs it.
Catalog record
| CREATOR | Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29400
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Adaptively Allocate Gaussians for Arbitrary-Scale Image Super-Resolution CCS: Computing methodologies Image representations CCS: Computing methodologies Reconstruction CCS: Computing methodologies Neural networks CCS: Computing methodologies Learning latent representations CCS: Computing methodologies Rasterization CCS: Computing methodologies Image processing CCS: Computing methodologies Point-based models Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto Abstract . In computer graphics, visual content is continuously warped, zoomed and resampled. This adaptation is required when engines upscale frames to native resolutions, users zoom into 3D scenes, or foveated VR applies varying scaling. Handling these dynamic transformations requires Arbitrary-Scale Super-Resolution (ASR) . However, traditional models are designed for fixed integer scales. To achieve continuous scales, they typically predict at a lower fixed scale (e.g., × 4 \times 4 ) and rely on sub-optimal interpolation to reach the target resolution, compromising quality. Furthermore, state-of-the-art methods generally process pixels uniformly. Since fine details are typically sparse, uniform processing incurs unnecessary overhead; efficiency dictates concentrating resources strictly where structural complexity demands it. While implicit models and Gaussian Splatting (GS) enable continuous representation, the latter is particularly advantageous due to its adaptive densification. However, transitioning GS into a generalized feed-forward model to solve the ASR task is not trivial. Standard GS optimization requires high-resolution ground-truth gradients to drive primitive growth. In contrast, when GS is used in a feed-forward model to solve the ASR task, this high-resolution target is unavailable during inference. Therefore, the network must autonomously predict the GS densification directly from the low-resolution input. To solve this, we propose QuADA-GS . Our model encodes the input into a latent feature space. A Neural Routing Architecture evaluates local complexity to distribute a global budget, assigning a specific upsampling factor to each feature to avoid redundant processing. Features are dynamically densified based on these factors, forming an irregular topology decoded into 2D Gaussian primitives. To coordinate features before decoding, we introduce Hierarchical Pointer Convolution . This non-grid operator achieves 𝒪 ( 1 ) \mathcal{O}(1) neighbor lookup complexity, facilitating efficient spatial communication across varying densities and bypassing dense operation bottlenecks. Extensive experiments show QuADA-GS achieves state-of-the-art ASR performance, excelling in perceptual fidelity, while maintaining low latency and a lean memory footprint by dynamically scaling Gaussian count. 1. Introduction Super-resolution (SR) methods have achieved remarkable reconstruction quality, yet most approaches operate at fixed integer scale factors, an assumption that rarely holds in production pipelines. Applications such as VFX compositing, custom-resolution display rendering, and large-format print output require upscaling to arbitrary, non-integer scales imposed by external constraints. To address this, Arbitrary-Scale SR (ASR) emerged. While Implicit Neural Representations (INRs) ( 10 ) advanced ASR by decoding continuous coordinates via Multi-Layer Perceptrons (MLPs), exhaustive pixel-by-pixel querying causes severe computational bottlenecks at high resolutions. Recently, 2D Gaussian Splatting (GS) ( 22 ) emerged as a powerful continuous alternative. Yet, recent ASR adaptations ( 17 ; 4 ) completely ignore the input’s spatial complexity, failing to inherit GS’s adaptive densification. By rigidly enforcing a uniform allocation strategy, they blindly expend the same Gaussian budget on flat backgrounds as on intricate textures. To break this rigidity, we propose a Qu adtree Ada ptive G aussian S platting ( QuADA-GS ) model for ASR. Driven by the input complexity and target scale, the framework first defines a global Gaussian budget . A dynamic router then learns to optimally allocate this capacity , replacing uniform densification with a spatially adaptive, quadtree-inspired topology. Since this variable-density structure breaks standard grid convolutions, we concurrently propose Hierarchical Pointer Convolution (HPC) . HPC efficiently coordinates multi-level features across this non-grid topology in \mathcal{O}(1) time, entirely bypassing the memory overhead of traditional sparse operators. Our main contributions are threefold: • Neural Routing Architecture : A module that analyzes the reconstruction complexity of the input image at a given resolution scale, defines a 2D Gaussian budget, and determines where and how to allocate them. • HPC : A novel operator that achieves \mathcal{O}(1) complexity for topological neighbor lookup, enabling efficient feature coordination across non-grid topologies without the prohibitive memory overhead of dense or sparse alternatives. • State-of-the-art ASR performance : QuADA-GS delivers superior texture reconstruction and optimal memory usage. Breaking dense uniformity allows scaling to massive Gaussian counts that cause out-of-memory failures in dense competitors. 2. Related Work Training Data and Evaluation. Image super-resolution (SR) aims to recover high-resolution (HR) details from low-resolution (LR) inputs. The SR ecosystem has shifted from rigid LR-HR pairs to perceptually guided ground truths ( 5 ) . For real-world Blind SR , simulating composite corruptions is essential for robustness ( 41 ; 52 ) . This shift prompted a rethinking of evaluation metrics ( 6 ) , acknowledging that reference images may carry intrinsic flaws and generative models often surpass them in perceived quality. Architectural Efficiency. Early convolutional networks expanded receptive fields via increased linear depth ( 23 ) , deep recursion ( 24 ) , and Laplacian pyramids ( 25 ) . Efficiency improved drastically by processing features in compressed, low-dimensional spaces and employing Residual-in-Residual structures to focus on high-frequency components ( 13 ; 42 ; 56 ; 57 ; 28 ) . The field then embraced Transformers: SwinIR ( 30 ) leveraged Swin blocks for deep extraction, ELAN ( 55 ) and HAT ( 9 ) optimized computational redundancy, and ATD-SR ( 53 ) introduced adaptive tokens to overcome the limited receptive fields of standard window-based attention. Diffusion Models and Hallucination. A critical issue with diffusion models in SR is their tendency to hallucinate non-existent structures. Mitigation strategies include structure-preserving losses ( 7 ) , local error isolation ( 29 ) , and text-prompted semantic coherence ( 45 ) . Furthermore, fixed-resolution grids and heavy VAE downsampling (e.g., 8\times ) intrinsically erase micro-structures. While latent alignment ( 48 ) and massive scaling ( 50 ) alleviate this, iterative sampling latency remains impractical for large-format images. Following ASR conventions , we exclude diffusion baselines: they lack non-integer scaling, risk benchmark leakage via massive priors, and hallucinate rather than strictly reconstruct. Arbitrary-Scale SR and Gaussian Splatting. To maintain structural fidelity without being constrained by fixed grids, Arbitrary-Scale Super Resolution (ASR) frames SR as a continuous representation problem. Meta-SR ( 18 ) and scale-aware plug-ins ( 39 ) broke the integer-scale constraint by dynamically predicting filter weights. LIIF ( 10 ) formalized ASR by training a Multi-Layer Perceptron (MLP) to predict RGB values from continuous spatial coordinates, a paradigm also effective for preserving sharp text in screen content (ITSRN ( 46 ) ). To overcome the MLP’s tendency to suppress high frequencies, LTE ( 26 ) mapped textures into 2D Fourier space, while LINF ( 47 ) modeled local texture distributions via Normalizing Flows. To expand the receptive field, CiaoSR ( 2 ) introduced implicit attention-in-attention. SRNO ( 44 ) reframed ASR through neural operators to map continuous function spaces, while LIT ( 8 ) improved inputs with frequency encodings. Since querying an MLP for every target coordinate is highly memory and time intensive, LMF ( 16 ) introduced a decoupled paradigm, confining heavy computation to the LR latent space and using a lightweight dynamic renderer. Recently, 2D Gaussian Splatting (GS) ( 22 ) has been adapted for ASR. GaussianSR ( 17 ) assigns a discrete, pre-trained