Challenges in 3D Data Synthesis for Training Neural Networks on Topological Features

Dylan PeekSchool of Information and Physical SciencesThe University of Newcastle, Australia [email protected], Matthew P. SkerrittDept. of Mathematical and Geospatial SciencesRMIT University, Australia [email protected], Siddharth PritamComputer Science GroupChennai Mathematical Institut · 2025

Read Challenges in 3D Data Synthesis for Training Neural Networks on Topological Features by Dylan PeekSchool of Information and Physical SciencesThe University of Newcastle, Australia [email protected], Matthew P. SkerrittDept. of Mathematical and Geospatial SciencesRMIT University, Australia [email protected], Siddharth PritamComputer Science GroupChennai Mathematical Institut (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04972.txt.

Introduction

Dylan Peek and co-authors tackle a data gap in teaching neural nets to read the shape traits of 3D forms. Classic tools that find holes and links in data are slow, so learned estimators could help, if labeled 3D data existed.

The team made a way to build labeled 3D sets with a set hole count, using a surface method that pushes points apart. They train a 3D network with attention to guess genus, the count of holes. Tests show that as forms warp more, scores fall, so warp matters as much as hole count.

Catalog record

CREATORDylan PeekSchool of Information and Physical SciencesThe University of Newcastle, Australia [email protected], Matthew P. SkerrittDept. of Mathematical and Geospatial SciencesRMIT University, Australia [email protected], Siddharth PritamComputer Science GroupChennai Mathematical Institut
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04972

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Challenges in 3D Data Synthesis for Training Neural Networks on Topological Features Dylan PeekSchool of Information and Physical SciencesThe University of Newcastle, Australia [email protected], Matthew P. SkerrittDept. of Mathematical and Geospatial SciencesRMIT University, Australia [email protected], Siddharth PritamComputer Science GroupChennai Mathematical Institute, India [email protected], Stephan ChalupSchool of Information and Physical SciencesThe University of Newcastle, Australia [email protected] Abstract Topological Data Analysis (TDA) involves techniques of analyzing the underlying structure and connectivity of data. However, traditional methods like persistent homology can be computationally demanding, motivating the development of neural network-based estimators capable of reducing computational overhead and inference time. A key barrier to advancing these methods is the lack of labeled 3D data with class distributions and diversity tailored specifically for supervised learning in TDA tasks. To address this, we introduce a novel approach for systematically generating labeled 3D datasets using the Repulsive Surface algorithm, allowing control over topological invariants, such as hole count. The resulting dataset offers varied geometry with topological labeling, making it suitable for training and benchmarking neural network estimators. This paper uses a synthetic 3D dataset to train a genus estimator network, created using a 3D convolutional transformer architecture. An observed decrease in accuracy as deformations increase highlights the role of not just topological complexity, but also geometric complexity, when training generalized estimators. This dataset fills a gap in labeled 3D datasets and generation for training and evaluating models and techniques for TDA. 1 Introduction Figure 1 : A 2D slice of a sample generated using the technique outlined in Section 3 . The 2D binary image shows 6 holes across 4 disconnected objects. Top: raw sample. Bottom: annotated analysis. Figure 2 : Random growth of interlinked genus 2 (green) and genus 3 (brown) objects using the method outlined in Section 3 . Visualisation performed in Blender 3.0.1. Blender Foundation 2021 The shape of an object is an essential feature that can be used for classification. Topology is the branch of mathematics that formalizes the study of shapes through a rigorous analysis of connectivity, cavities, and holes within an object. Topological Data Analysis (TDA), a relatively new field at the intersection of mathematics, computer science, and data science, focuses on analyzing the shape of data or objects ( Hatcher 2002 ; Edelsbrunner and Harer 2010 ) . TDA offers powerful tools, such as Persistent Homology (PH), for understanding complex data by extracting topological features like n -dimensional holes, which uncover underlying patterns and relationships. While Persistent Homology is a powerful tool, it has certain drawbacks, such as high computational cost, particularly for large datasets. To address this, machine learning techniques have been proposed and successfully applied to extract topological features and signatures ( Paul and Chalup 2019 ; Hannouch and Chalup 2023 ; Peek et al. 2023 ; de Surrel et al. 2022 ) . The underlying idea behind these studies is to bypass the persistent homology computation and directly estimate or predict topological invariants, such as Betti numbers and genus , through neural networks to reduce computational cost and gain additional insights. Additionally, neural networks have been employed in various other TDA tasks, including analyzing outputs from traditional techniques like persistent homology for applications such as medical diagnosis and classification ( Yamanashi et al. 2021 ; Rucco et al. 2014 ; Chung et al. 2021 ) . Approaches that bypass PH computation and directly estimate topological invariants typically require large datasets for training and testing. The availability of such extensive data repositories is a major bottleneck in the further development of this area. Our current work addresses this issue by proposing a new method to synthetically generate complex and versatile labeled datasets suitable for the training and testing of neural networks in topological classification. An example of a visual approach to estimating hole counts in 2D data can be seen in Fig. 1 . This example is a 2D cross-section of the 3D generation process outlined in Section 3 . Our method utilizes the Repulsive Surfaces algorithm Yu et al. 2021 to perform homeomorphic (i.e., topology-preserving) deformations with randomized parameters and environmental constraints. This process generates a sequence of 3D data with known labels through an iterative growth mechanism, as illustrated in Fig. 6 . This data generation approach allows for: • Incremental complexity in the generated data, making it suitable for both 3D or time-series 3D tasks. This also allows the accuracy of a model to be assessed at various geometrically complex stages while retaining the same topological complexities. • Customizable growth configurations, allowing for adaptation to various applications and styles. Our method fills a critical gap in accessible, topologically labeled 3D/4D data and has been utilized to train neural networks for TDA tasks using ‘Betti Number’ topological signatures (in a form we refer to as ‘genus’ in this paper, see Section 2 ). We demonstrate the efficacy of this synthetic data generation method through experiments with a 3D Convolutional Transformer Network (3DCTN) ( Lu et al. 2022 ) . The dataset used in these experiments is called the Random Grid Repulse Dataset, or simply ‘RG Repulse.’ Details of the generation process are provided in Section 4 . 1.1 Related Works Previous studies have used a variety of datasets and output structures to perform TDA on raw input data. One line of work has applied convolutional neural network architectures to estimate the Betti numbers of 2D and 3D data Paul and Chalup 2019 . The 2D model was trained on image data consisting of randomly placed circles with randomized radii, and for the 3D model, this approach was scaled into 3D with random spheres embedded in a volumetric space. The concept has also been extended to 4D, where a synthetic dataset introduced higher-dimensional holes through cutouts from a solid 4D structure, with objects randomly scaled and rotated Hannouch and Chalup 2023 . Deep learning models have also been developed to estimate topological features directly from images Som et al. 2020 . For example, Pi-Net was trained using datasets such as SVHN ( Netzer et al. 2011 ) , CIFAR10, and CIFAR100 ( Krizhevsky and Hinton 2009 ) . The SVHN dataset features photos of house numbers, while CIFAR100 includes 100 common classes such as ship’ or dog’. Other efforts have focused on 3D point cloud TDA, with one approach sampling point clouds from the surface of objects in the ModelNet10 dataset ( Wu et al. 2015 ) to train a RipsNet model designed for topological feature extraction de Surrel et al. 2022 . A similar strategy was employed to train TopologyNet using the expanded ModelNet40 dataset, which includes 40 object classes instead of 10 Zhou et al. 2022 . A key limitation across these studies is dataset availability. Datasets like CIFAR100, SVHN, and ModelNet40 contain strong correlations between the geometrical and topological properties of the objects. For example, recognizing that an object is a ‘mug’ inherently provides information about its toroidal topology. This correlation makes it difficult for networks to learn topological features independently of geometrical ones, potentially leading to overfitting. Additionally, these datasets possess fewer hole counts and limited topological complexity, restricting the variety of topological features. Finally, the distribution of samples in these datasets is optimized for object classification, not for balancing topological features like

Read the complete text