Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Prediction
Chun-Peng Chang Shaoxiang Wang Alain Pagani Dariu Gavrila Holger Caesar · 2026
Read Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Prediction by Chun-Peng Chang Shaoxiang Wang Alain Pagani Dariu Gavrila Holger Caesar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15923.txt.
Introduction
Chun-Peng Chang and four colleagues present Invaria, a point cloud encoder with scale-density invariance via next-resolution prediction and receptive fields. 3D encoders prove sensitive to sampling resolution and scale changes, since models overfit densities and scales rather than learning invariants. Next-resolution prediction teaches invariants, and the encoder gains during resolution shifts while staying efficient through size and fewer tokens. On ScanNet, Invaria scores 56.0 percent higher mIoU at 3 times lower resolution and 20 percent higher at 3 times smaller scale, with a 45 percent smaller model and 40 percent fewer tokens.
Catalog record
| CREATOR | Chun-Peng Chang Shaoxiang Wang Alain Pagani Dariu Gavrila Holger Caesar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85137 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15923
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Prediction Chun-Peng Chang Shaoxiang Wang Alain Pagani Dariu Gavrila Holger Caesar Abstract Modern image encoders achieve high generalization by decoupling semantic meaning from resolution, an ability yet to be fully realized in the 3D domain. We investigate the failure of 3D point cloud encoders to achieve similar generalization and find that existing models are highly sensitive to sampling resolution and scale changes, leading to significant performance degradation. This sensitivity is a major bottleneck for real-world deployment in robotics, as it suggests models overfit to specific quantization densities and object scales rather than learning invariant semantic features. To mitigate this dependency, we propose Invaria, a point cloud encoder that achieves scale and density invariance through next-resolution prediction and receptive field calibration. While our objective is not the explicit generation of high-resolution point clouds, we find that this training objective encourages the model to learn robust, structural invariants. The resulting encoder achieves significant performance gains during resolution shifts while maintaining high efficiency through a compact model size and reduced token requirements. Specifically, on ScanNet, Invaria achieves a 56.0% higher mIoU at 3 × \times lower resolution and a 20% improvement when the objects scale is reduced by a factor of 3. These gains are achieved with a 45% smaller model size and an average reduction of 40% in input tokens. 1 Introduction Humans possess an inherent ability to recognize objects regardless of scale and resolution. Modern image encoders [ 34 , 15 ] have successfully mirrored this capability, enabling seamless domain transfer from high-quality public datasets to real-world or simulated environments without requiring retraining or fine-tuning. In 3D point cloud, this ability is equally critical for deployment such as robotics when the device generates non-uniform and low resolution point clouds that vary with sensor quality and hardware/latency constraints [ 43 ] . However, despite significant progress in 3D perception [ 13 , 42 , 55 , 46 , 44 , 53 ] , our research suggests that existing point cloud methods remain inherently dependent on specific sampling resolutions, which is often defined as the discretization grid size used to quantize local signals. This dependency causes performance degradation whenever the input resolution shifts from the training distribution. In this work we focus on two primary factors contributing to this sensitivity: (1) Density : the number of points used to represent an object, which can affect the model’s ability to recognize the object [ 32 , 22 ] ; and (2) Scale : Operations within the model such as pooling and sparse convolution rely on the grid size to define their effective receptive field [ 42 ] ; changing the grid size therefore also changes the object size perceived by the model [ 33 ] . This highlights another deficiency in existing models: their failure to acquire scale-invariant features, which prevents reliable object recognition when the scale deviates from the training distribution. See Figure 1 for the example. To address these challenges, we propose Invaria , a method that prevents models from depending on specific input resolutions and enhances robustness against density and scale changes. Existing encoders often struggle because they easily adopt "shortcuts" during training [ 17 , 44 ] . Specifically, they learn to recognize objects based on a specific point density or a fixed receptive field defined by the grid size (scale), rather than the object’s actual shape. Invaria mitigates this by utilizing a next-resolution prediction training pipeline with receptive field calibration. By predicting the semantic features of higher-resolution targets from sparser inputs in the latent space, the model learns to decouple semantic meaning from specific sampling resolutions. This encourages the encoder to capture the object’s fundamental structural invariants, the geometric relationships that define it regardless of resolution or scale. Beyond robust feature representation, model efficiency, specifically in terms of parameter count and computational overhead, is a critical metric for 3D perception. Following the success of transformers [ 41 , 3 , 6 , 56 ] , state-of-the-art models [ 55 , 46 , 45 , 26 ] have shifted toward transformer-based architectures, which are powerful yet often computationally expensive. Furthermore, as self-supervised learning (SSL) and scaling laws have proven their efficacy, recent works [ 44 , 53 , 54 ] have leveraged SSL and increased model and data scales to enhance performance. While effective, this progress comes at a significant cost: the reliance on massive data and model sizes leads to high computational requirements, complicating real-world deployment on resource-constrained devices. Conversely, by training with our proposed pipeline, our method demonstrates robust performance across varying resolutions while maintaining competitive performance at the default resolution with a significantly smaller model size. Specifically, when compared to state-of-the-art models on ScanNet, our method achieves a 56.0% higher mIoU at 3 \times lower resolution (i.e., 3 \times the default grid size); and 20% higher mIoU when the objects scale is reduced by a factor of 3. Moreover, this resolution-invariant property provides a significant computational advantage: the model can encode high-resolution features from lower-resolution inputs. This yields an average reduction of around 40% in input tokens, a factor to which transformer-based architectures are particularly sensitive. Consequently, our approach allows the network to maintain dense semantic representations while significantly lowering the computational overhead associated with the backbones. Figure 1 : The generalization gap in 3D understanding. (Left) Humans and modern image encoders can seamlessly generalize a semantic concept (like "chair") across diverse resolutions and sizes (Right). Modern 3D encoders, on the other hand do not demonstrate similar ability, as they fail to understand semantic concepts independently of the underlying point density and scale. In summary, the main contributions of this work are as follows: • We investigate the sensitivity of existing point cloud encoders to sampling resolution and specifically focus on how the density shortcut and scale dependency can degrade the model’s performance. • We introduce Invaria , a point cloud encoder designed to learn scale- and density-invariant features. Specifically, we apply next-resolution prediction with receptive field calibration to encourage the model to align features in the latent space that remain robust as resolution and scale shift. • In contrast to current methods that rely on increasing data and model scales, Invaria achieves invariant features with a more compact architecture. Moreover, by leveraging resolution-invariant representations we can further reduce input token counts by utilizing lower-resolution point clouds, a crucial advantage for transformer-based backbones. 2 Semantic Consistency and Resolution Shift Figure 2 : Comparison on ScanNet semantic segmentation. The first row displays model performance when evaluated at the same resolution. The second row illustrates the impact of shifting the resolution during inference. For clear visual comparison, results from both methods are projected on the original point cloud. The black spot in GT means no label. See Appendix E Figure 8 for more examples. The representation of the continuous world in digital form necessitates a discretization process that reduces continuous visual detail into a discrete set of data points. In the 2D domain, this is achieved by sampling a scene at a specific resolution with corresponding number of pixels. Modern image encoders [ 7 , 21 , 26 , 47 , 36 ] have mastered the extraction of