SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling
Xianglong He 1,2⋆ Zi-Xin Zou 2⋆ Chia-Hao Chen 1,2 Yuan-Chen Guo 2 Ding Liang 2 Chun Yuan 1† Wanli Ouyang 3 Yan-Pei Cao 2 Yangguang Li 2† 1 Tsinghua University 2 VAST 3 The Chinese University of Hong Kong · 2025
Read SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling by Xianglong He 1,2⋆ Zi-Xin Zou 2⋆ Chia-Hao Chen 1,2 Yuan-Chen Guo 2 Ding Liang 2 Chun Yuan 1† Wanli Ouyang 3 Yan-Pei Cao 2 Yangguang Li 2† 1 Tsinghua University 2 VAST 3 The Chinese University of Hong Kong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21732.txt.
Introduction
Xianglong He and co-authors present a sparse method to model 3D shapes at high detail with any surface type. Their 2025 system, called SparseFlex, handles open surfaces and inner parts that stump past methods. Watertight conversion in older tools is costly and blurs detail.
The method builds on a cube-based surface form but computes only near the surface. A window-aware training plan lights up just the voxels in view, which slashes memory use. Mesh interiors can now be rebuilt from rendering loss alone. A full pipeline with a shape autoencoder and a flow model generates fresh shapes. Tests show large gains in accuracy over past methods, with far lower surface error.
Catalog record
| CREATOR | Xianglong He 1,2⋆ Zi-Xin Zou 2⋆ Chia-Hao Chen 1,2 Yuan-Chen Guo 2 Ding Liang 2 Chun Yuan 1† Wanli Ouyang 3 Yan-Pei Cao 2 Yangguang Li 2† 1 Tsinghua University 2 VAST 3 The Chinese University of Hong Kong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21732
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling Xianglong He 1,2⋆ Zi-Xin Zou 2⋆ Chia-Hao Chen 1,2 Yuan-Chen Guo 2 Ding Liang 2 Chun Yuan 1† Wanli Ouyang 3 Yan-Pei Cao 2 Yangguang Li 2† 1 Tsinghua University 2 VAST 3 The Chinese University of Hong Kong Abstract Creating high-fidelity 3D meshes with arbitrary topology, including open surfaces and complex interiors, remains a significant challenge. Existing implicit field methods often require costly and detail-degrading watertight conversion, while other approaches struggle with high resolutions. This paper introduces SparseFlex, a novel sparse-structured isosurface representation that enables differentiable mesh reconstruction at resolutions up to 1024 3 1024^{3} directly from rendering losses. SparseFlex combines the accuracy of Flexicubes with a sparse voxel structure, focusing computation on surface-adjacent regions and efficiently handling open surfaces. Crucially, we introduce a frustum-aware sectional voxel training strategy that activates only relevant voxels during rendering, dramatically reducing memory consumption and enabling high-resolution training. This also allows, for the first time, the reconstruction of mesh interiors using only rendering supervision. Building upon this, we demonstrate a complete shape modeling pipeline by training a variational autoencoder (VAE) and a rectified flow transformer for high-quality 3D shape generation. Our experiments show state-of-the-art reconstruction accuracy, with a ∼ \sim 82% reduction in Chamfer Distance and a ∼ \sim 88% increase in F-score compared to previous methods, and demonstrate the generation of high-resolution, detailed 3D shapes with arbitrary topology. By enabling high-resolution, differentiable mesh reconstruction and generation with rendering losses, SparseFlex significantly advances the state-of-the-art in 3D shape representation and modeling. Please see our project page at https://xianglonghe.github.io/TripoSF . † † footnotetext: \star Equal contribution. {\dagger} Corresponding authors. 1 Introduction 3D Generative AI is rapidly advancing, with applications spanning entertainment, design, and robotics. However, generating 3D content is fundamentally more challenging than 2D image or text generation due to the inherent complexity of representing and manipulating 3D geometry. Achieving high fidelity and supporting arbitrary topology —including open surfaces and complex interiors—presents particularly significant hurdles. Recent progress in 3D generative models has explored various representations, including point clouds [ 52 , 46 , 68 , 45 ] , meshes [ 63 , 51 ] , 3DGS [ 18 , 88 , 78 , 32 ] , and implicit fields [ 91 , 87 , 59 , 35 , 93 , 10 , 77 , 34 , 78 , 95 , 9 ] . Implicit field representations, such as Signed Distance Functions (SDFs) and occupancy fields, have shown favorable results [ 87 , 85 , 77 , 31 , 78 , 95 ] . However, creating training data for these methods typically involves a two-step process that limits their effectiveness. First, raw 3D mesh data must be converted into watertight representations [ 91 , 79 ] to calculate SDF or occupancy values—a computationally expensive preprocessing step that often degrades fine details. Second, isosurfacing techniques (e.g., Marching Cubes [ 43 ] , Dual Contouring [ 26 ] ) are used to extract meshes from the learned continuous field, which can introduce further inaccuracies and artifacts. While Unsigned Distance Fields (UDFs) offer a potential way to model open surfaces [ 11 , 38 , 42 , 84 , 16 , 6 ] , they often suffer from instability and struggle to capture geometric fine details. Rendering-based supervision offers a powerful, differentiable alternative for training 3D representations and 3D generative models [ 74 , 60 , 61 , 78 , 80 , 73 ] . By directly comparing rendered images of a generated mesh to ground-truth data, rendering losses avoid the need for the initial watertight preprocessing step and better preserve fine details. However, a critical bottleneck arises: when used with dense implicit fields, rendering supervision requires extremely high memory consumption at high resolutions, severely limiting the achievable fidelity. This paper introduces SparseFlex , a new sparse-structured isosurface representation that addresses these limitations and unlocks high-resolution, differentiable mesh reconstruction and generation using rendering supervisions. SparseFlex is built upon Flexicubes [ 61 ] , providing accurate and differentiable isosurface extraction. The key design is the use of a sparse voxel structure instead of a conventional dense grid. This sparsity is crucial for two primary reasons: (1) it dramatically reduces memory consumption, enabling high-resolution modeling , and (2) it allows for the effective pruning of voxels near open boundaries, enabling the representation of open surfaces . To fully leverage the capabilities of SparseFlex, we propose frustum-aware sectional voxel training . Inspired by techniques used in real-time rendering [ 1 ] , this approach activates only the subset of SparseFlex voxels that reside within the camera’s viewing frustum during each training iteration. We also introduce an adaptive strategy to control the frustum’s parameters, further optimizing memory usage. This not only substantially reduces computational and memory overhead but also enables, for the first time, the reconstruction of mesh interiors using only rendering supervision by appropriately positioning the camera. Fig. 3 illustrates our SparseFlex representation and the efficient sectional voxel training strategy. Building on SparseFlex and our frustum-aware training, we present a complete 3D shape modeling pipeline. We employ a variational autoencoder (VAE) architecture, drawing inspiration from TRELLIS [ 78 ] but with key modifications. Firstly, because our focus is on high-fidelity geometry , we use point clouds as input to the VAE, providing a direct and detailed representation of the shape’s surface. Furthermore, we introduce a self-pruning upsampling module within the decoder to further refine the sparse voxel structure, which is particularly beneficial for representing open surfaces. A rectified flow transformer is then trained on the learned latent space for high-quality, image-conditioned 3D shape generation. Through extensive experiments on Toy4k [ 64 ] , ABO [ 12 ] , GSO [ 15 ] , Meta [ 48 ] , Objaverse [ 14 ] , and Deepfashion3D [ 19 ] , our method demonstrates state-of-the-art shape reconstruction accuracy with minimal detail degradation, and high-quality single-image 3D shape generation. Our main contributions are: • We propose SparseFlex, a new sparse-structured isosurface representation enabling efficient, high-resolution, and differentiable 3D shape modeling, with natural handling of open surfaces. • We introduce a novel sectional voxel training strategy with adaptive view frustum control, dramatically reducing memory consumption and enabling high-resolution mesh reconstruction and generation, including interiors, using rendering losses. • We demonstrate state-of-the-art reconstruction accuracy and the generation of high-resolution, detailed 3D shapes with arbitrary topology, representing a significant advance in the field. 2 Related Work 2.1 3D Shape Representations for Generation Point Cloud. Point clouds are a flexible 3D representation and can be easily acquired using depth sensors and LiDAR. Research has focused on point cloud processing [ 57 , 58 , 92 ] and generation [ 52 , 46 , 68 , 45 ] , with recent approaches treating point clouds as a distribution, directly sampling point clouds from noise via generative models [ 89 , 4 ] . However, due to their limitation in representing solid surfaces, an additional surface reconstruction step [ 27 , 22 , 56 ] is required. Triangle Mesh. Triangle meshes are the primary representation for 3D assets in modern industrial pipelines. Recent works employ auto-regressive models to generate triangle faces sequentially [ 63 , 51 , 66 ] , improving resemblance to