Learning Convex Decomposition via Feature Fields
Yuezhi Yang, Qixing Huang, Mikaela Angelina Uy, Nicholas Sharp · 2026
Read Learning Convex Decomposition via Feature Fields by Yuezhi Yang, Qixing Huang, Mikaela Angelina Uy, Nicholas Sharp (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09285.txt.
Introduction
Yuezhi Yang and colleagues recast convex decomposition of 3D shapes as feature field learning, where a continuous field over a shape can later be clustered. Splitting shapes into unions of convex bodies speeds collision checks in physical simulation and more. Their self-supervised aim comes straight from the classical definition of convexity, so no labeled parts are needed. The result is the first learned model of its kind that works feed-forward on open-world shapes, giving higher-quality splits that carry across meshes, CAD models, and Gaussian splats.
Catalog record
| CREATOR | Yuezhi Yang, Qixing Huang, Mikaela Angelina Uy, Nicholas Sharp |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40929 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.09285
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Convex Decomposition via Feature Fields Yuezhi Yang, Qixing Huang, Mikaela Angelina Uy, Nicholas Sharp Abstract This work proposes a new formulation to the long-standing problem of convex decomposition through learning feature fields, enabling the first feed-forward model for open-world convex decomposition. Our method produces high-quality decompositions of 3D shapes into a union of convex bodies, which are essential to accelerate collision detection in physical simulation, amongst many other applications. The key insight is to adopt a feature learning approach and learn a continuous feature field that can later be clustered to yield a good convex decomposition via our self-supervised, purely-geometric objective derived from the classical definition of convexity. Our formulation can be used for single shape optimization, but more importantly, feature prediction unlocks scalable, self-supervised learning on large datasets resulting in the first learned open-world model for convex decomposition. Experiments show that our decompositions are higher-quality than alternatives and generalize across open-world objects as well as across representations to meshes, CAD models, and even Gaussian splats. https://research.nvidia.com/labs/sil/projects/learning-convex-decomp/ 1 Introduction Convex decomposition approximates detailed, nonconvex 3D shapes with a simple set of convex bodies—these convex approximations are essential geometric accelerations for fast collision detection 53 ; 20 ; 35 , signed-distance computation 30 , motion animation 37 ; 26 , and more, which all must efficiently compute distances and spatial bounds. Traditionally, such decompositions were manually authored by technical artists as part of the content creation process, but the prevalence of automated 3D pipelines and generative AI has created ever-increasing demand for algorithmic construction of convex decompositions. In particular, recent progress in physical robotics training environments demands robust, high-performance simulation of generated assets and world models—convex decompositions are essential to enable these simulations 1 . Figure 1 : Our method takes an input shape ( top ), infers features from an open-world model learned with our new self-supervised geometric loss ( middle ), and clusters those features to fit the shape with a collection of tight convex bounding proxies ( bottom ). However, convex decomposition has thus far remained a remarkably challenging algorithmic task; one must accurately approximate the starting shape in the geometric sense, as well as a combinatorial covering problem that is formally NP-hard in the worst case 7 ; 40 . Traditional approaches from computational geometry use branch-and-bound techniques to explore a search space of possible decompositions, but can be prohibitively computationally expensive 8 ; 4 ; 25 . The learned architectures have also explored representing shapes with convex primitives, but thus far have been limited to narrow families of objects rather than to general open-world content 10 ; 14 . Moreover, much past work has focused almost entirely on mesh decomposition, whereas geometry increasingly comes from imprecise representations such as Gaussian splats. This work proposes a new formulation for convex decomposition, which allows us to train a feedforward open-world model directly producing high-quality convex decompositions of shapes. Our key insight is to adopt a feature learning approach. Rather than directly optimizing or learning a discrete set of primitives, we instead operate on continuous features defined along the shape, constructing a set of features such that clustering them yields a good convex decomposition. To make this possible, we introduce a new self-supervised contrastive loss on features, inspired by a classic geometric definition of convexity: lines connecting pairs of points should be contained within the shape. We validate our approach against both classical and deep learning baselines, demonstrating superior performance across multiple datasets. Beyond quantitative gains, we also showcase the practical utility of our method, enabling collision detection, control over granularity (Fig. 2 ), and generalization to various input modalities such as Gaussian splats. The main contributions of this work are summarized as follows: • We formulate convex decomposition as a contrastive learning problem and introduce our novel, self-supervised, geometric loss that enables scalable learning of convex decomposition on open-world data. • We train a feedforward network that enables state-of-the-art performance on convex decomposition, fast inference, and generalization to different 3D modalities. • We demonstrate the effectiveness of our approach in different downstream applications such as multi-granularity decompositions, collision detection and generalization to different input modalities. Figure 2 : By adjusting the clustering threshold, our method can generate decompositions at varying granularity, all from the same feature field. 2 Related Work Classic Convex Decomposition Convex decomposition is a long-studied problem in computational geometry 8 ; 40 ; 3 ; 35 enabling applications such as fast and precise collision detection 53 ; 20 ; 35 , shape deformation 59 , distance computation 48 ; 21 , skeleton extraction 26 , animation 37 , segmentation 16 , simulation and gaming 1 . The task of exact convex decomposition —decomposing a shape into the minimum number of strictly convex components—is known to be NP-hard 7 ; 40 . Multiple works 3 ; 4 ; 8 ; 22 ; 23 introduce different heuristics to tackle this problem but often produce a large number of components that limit practical use. This led to the problem of approximate convex decomposition 25 that instead only requires components to be nearly convex, where they first define a concavity metric that measures the deviation of a component with its convex hull, then iteratively decomposes a shape until the concavity metric for all components is below a selected threshold. Concavity metrics have been defined based on the boundary of the component 25 ; 19 ; 27 ; 33 , volume 34 ; 2 ; 51 or surface visibility 28 ; 45 with respect to its corresponding convex hull. Notably, V-HACD 34 has long been widely-used due to easily-available implementations and robust performance, while recently CoACD 58 improved it by introducing a collision-aware concavity metric based on both the shape’s boundary and interior volume. RL-ACD 32 replaces searching with reinforcement learning to improve efficiency. Although these methods perform acceptably well on general shapes, the search space over all partitions to minimize concavity is enormously large, resulting in methods that are computationally slow even with assumptions such as axis-aligned cuts 58 and voxelization 34 to remain tractable. Learning-based Methods The prevalence of deep learning has spurred efforts to replace these classical search algorithms with data-driven optimization. Lacking ground-truth labels for optimal convex decompositions, learning-based methods such as BSP-Net 10 and Cvx-Net 14 , adopt a self-supervised paradigm, where they define a fixed set of half-planes, and learn to optimize and assemble them to reconstruct the target shape. Although these approaches have shown promise in category-level datasets 6 , the reconstruction objective fundamentally limits their scalability to large-scale topological and geometric variations in open-world data 12 ; 13 . Related to this line of work is learning-based shape abstraction, where the goal is to approximate the input shape into simple primitives. These works are commonly self-supervised with reconstruction 52 ; 42 ; 17 ; 46 or rendering 18 ; 36 to abstract the shape into simple primitives such as cuboids 64 ; 52 ; 60 ; 47 , superquadrics 42 ; 30 ; 15 ; 18 ; 57 , superellipses 63 or differentiable support functions 41 . Part-based decomposition 29 ; 49 ; 43 ; 61 has also been explored and shares some similarities with our setting, however, it does not