Exploring 3D Dataset Pruning

Xiaohan Zhao, Xinyi Shang, Jiacheng Liu, Zhiqiang Shen · 2026

Read Exploring 3D Dataset Pruning by Xiaohan Zhao, Xinyi Shang, Jiacheng Liu, Zhiqiang Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00651.txt.

Introduction

Zhao and three colleagues study data set pruning for three dimensional data, largely unexplored next to pruning for flat images. Long tailed classes make overall and mean scores pull in opposite directions, complicating pruning choices. They frame pruning as matching full data risk with a weighted subset, exposing coverage gaps and prior mismatch bias. Careful selection with per class keep quotas protects long tail coverage, while prior free teacher guidance with calibrated soft labels and embedding geometry distillation steadies training. Tests show both scores improve across settings.

Catalog record

CREATORXiaohan Zhao, Xinyi Shang, Jiacheng Liu, Zhiqiang Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53073
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00651

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring 3D Dataset Pruning Xiaohan Zhao, Xinyi Shang, Jiacheng Liu, Zhiqiang Shen Abstract Dataset pruning has been widely studied for 2D images to remove redundancy and accelerate training, while particular pruning methods for 3D data remain largely unexplored. In this work, we study dataset pruning for 3D data, where its observed common long-tail class distribution nature make optimization under conventional evaluation metrics Overall Accuracy (OA) and Mean Accuracy (mAcc) inherently conflicting, and further make pruning particularly challenging. To address this, we formulate pruning as approximating the full-data expected risk with a weighted subset, which reveals two key errors: coverage error from insufficient representativeness and prior-mismatch bias from inconsistency between subset-induced class weights and target metrics. We propose representation-aware subset selection with per-class retention quotas for long-tail coverage, and prior-invariant teacher supervision using calibrated soft labels and embedding-geometry distillation. The retention quota also serves as a switch to control the OA-mAcc trade-off. Extensive experiments on 3D datasets show that our method can improve both metrics across multiple settings while adapting to different downstream preferences. Our code is available on Github . 1 Introduction Dataset pruning ( 20 ; 24 ) , also known as coreset selection, is a well-established approach for reducing redundancy in large-scale training sets. In 2D image classification, many data pruning strategies have been extensively studied, including geometry-based clustering ( 26 ) , gradient matching ( 15 ; 13 ) , and error-based importance estimation ( 20 ; 27 ) . These methods can significantly accelerate training and reduce computational cost, and have been adopted in downstream scenarios such as hyper-parameter tuning ( 35 ) and continual learning ( 10 ) . More recently, dataset pruning has also been combined with knowledge distillation ( 5 ; 2 ) , where a teacher trained on the full dataset guides both subset selection and post-pruning optimization. Figure 1 : Grouped class distribution of ShapeNet55. Table 1 : Statistics of 3D imbalance on both train and test set. Train Set Test Set Dataset Total Max Min Ratio Total Max Min Ratio ScanObjectNN 11,416 1,585 298 5.3 \times 2,882 390 83 4.7 \times ModelNet40 9,840 889 64 13.9 \times 2,468 100 20 5.0 \times ShapeNet55 41,952 6,747 44 153.3 \times 10,518 1,687 12 140.6 \times Despite this progress, dataset pruning for 3D data remains unexplored as 3D datasets are expensive to build, and their class frequencies are rarely balanced by design. In practice, 3D data are often collected through manual modeling, such as CAD repositories, or through real-world scanning, so both training and test sets naturally inherit long-tailed distributions shaped by object frequency or dataset construction preferences. As a result, severe class imbalance is common in 3D benchmarks (see Fig. 1 and Tab. 1 ), making pruning substantially more challenging than in standard 2D settings. A key difficulty in 3D pruning is the tension between two widely used evaluation metrics: mean class accuracy (mAcc) and overall accuracy (OA). mAcc measures balanced performance across classes, while OA reflects expected utility under the naturally imbalanced test distribution. In 3D benchmarks, OA should not be viewed merely as a biased alternative to mAcc, when the test set is itself long-tailed, OA is the empirical estimate of performance under real query frequencies. Therefore, a practical pruning method for 3D data should account for both metrics, rather than optimizing only one at the expense of the other. We argue that this challenge should not be addressed by making an early trade-off between OA and mAcc. Instead, the first step is to identify principles that are robust across different target priors, and only then introduce mechanisms for preference adjustment. To this end, we formulate pruning as a quadrature approximation of population risk and decompose the resulting error into two terms: representation error , which captures how well the selected subset covers the underlying data manifold, and prior-mismatch bias , which arises when the class distribution induced by the pruned subset differs from the distribution implied by the target evaluation metric. This perspective shows that no single subset is optimal for all priors, but also reveals shared optimization directions that can improve performance under both OA and mAcc. Based on our theoretical analysis, we propose 3D-Pruner . To reduce prior-mismatch bias, we decouple prior-robust class-conditional structure from prior-dependent offsets, and transfer this structural information through knowledge distillation. Specifically, we use calibrated soft targets together with geometry- and relation-preserving distillation to make supervision less sensitive to class-frequency bias. To reduce representation error, we analyze different selection signals under imbalanced 3D data and find that classifier-derived scalar scores are strongly correlated with class size, while embedding geometry is substantially more stable. We therefore perform subset selection based on representation coverage in the embedding space, together with a small per-class safety quota to preserve long-tail coverage and secure a strong shared performance floor across priors. Finally, since different downstream applications may prefer different evaluation priors, we introduce a lightweight steering wrapper that interpolates between stratified seeding and global selection, enabling flexible control over the trade-off between mAcc and OA for better downstream performance. Our contributions are summarized as follows: (i) We identify a core challenge in 3D dataset pruning under long-tailed train/test splits: OA and mAcc reflect different yet practically important evaluation priors, making effective pruning fundamentally difficult. (ii) We formulate pruning as quadrature over population risk and decompose its error into representation error and prior-mismatch bias, providing a prior-robust perspective that applies across different target priors. (iii) Based on the analysis, we propose 3D-Pruner , a 3D data pruning framework that improves the performance through a simple steering wrapper. To the best of our knowledge, this is the first principled study of 3D dataset pruning. Figure 2 : Illustration of our 3D-Pruner framework, which comprises: (1) base principles (utilizing embedding signals, minimum floor selection, and optimizing structural likelihood in post-pruning training) that remain robust and beneficial across different priors, derived from theoretical analysis of the shared region, and (2) a steering warper that balances between the two priors. 2 Background 3D Datasets. 3D recognition benchmarks are essential for geometric learning, yet such data are costly to acquire and curate. Widely used datasets derive from two pipelines: curated CAD repositories (e.g., ModelNet40, ShapeNet ( 34 ; 4 ; 36 ) ) and real-world scanning with depth sensors (e.g., ScanObjectNN ( 29 ) ). Both share a common property: class frequencies are shaped by object availability and annotation cost rather than deliberate control, leading to long-tail imbalance in both training and evaluation splits (Fig. 1 , Tab. 1 ). This setting motivates reporting two complementary metrics driven by different evaluation priors . Let C be the number of classes, N the total test examples, and n_{y} the test examples in class y . Define per-class accuracy \mathrm{Acc}_{y}:=\frac{1}{n_{y}}\sum_{i:y_{i}=y}\mathbf{1}\{\hat{y}_{i}=y_{i}\} . Then: Overall accuracy (OA) with empirical prior \pi^{\mathrm{emp}}_{y}=n_{y}/N : \text{OA}=\sum_{y}\pi^{\mathrm{emp}}_{y}\,\mathrm{Acc}_{y}. OA reflects frequency as utility : users predominantly query common objects (e.g., doors, tables), so high OA indicates reliability for daily use with presumably higher tolerance of rare cases like a strange ancient vase, where the system’s value is determined by the cumulative success rate of user interactions. Mean class accuracy (mAcc) with uniform prior \pi^{\mathrm{uni}}_{y}=\frac{1}{C} : \text{mAcc}=\sum_{y}\pi^{\mathrm{uni}}_{y}\,\mathrm{Acc}_{y}. mAcc reflects capability versatility : every category

Read the complete text