Graph-Guided Dual-Level Augmentation for 3D Scene Segmentation DOI: XXXXXXX.XXXXXXX Conference: 33st ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3 CCS: Computing methodologies Scene understanding
Hongbin Lin, Yifan Jiang, Juangui Xu, Jesse J. Xu, Yi Lu, Zhengyu Hu, Ying-Cong Chen, Hao Wang · 2025
Read Graph-Guided Dual-Level Augmentation for 3D Scene Segmentation DOI: XXXXXXX.XXXXXXX Conference: 33st ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3 CCS: Computing methodologies Scene understanding by Hongbin Lin, Yifan Jiang, Juangui Xu, Jesse J. Xu, Yi Lu, Zhengyu Hu, Ying-Cong Chen, Hao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22668.txt.
Introduction
Hongbin Lin and seven co-authors build a way to make fake three-dim scenes for training tools that label each point in a scene. Their paper is from two thousand twenty-five.
Such tools need huge labeled sets, and boosted data ease that load. Past boosts shift local parts or remix sense, but miss the broad web of how things sit in a scene. The new way learns how things relate in real scenes, then builds guide graphs for new scenes. Checks at two levels keep the fakes sound: local checks hold shape and sense, and broad checks hold the scene's web. The aim is fakes that teach as well as real scans.
Catalog record
| CREATOR | Hongbin Lin, Yifan Jiang, Juangui Xu, Jesse J. Xu, Yi Lu, Zhengyu Hu, Ying-Cong Chen, Hao Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-22668
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Graph-Guided Dual-Level Augmentation for 3D Scene Segmentation DOI: XXXXXXX.XXXXXXX Conference: 33st ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland ISBN: 978-1-4503-XXXX-X/2018/06 123-A56-BU3 CCS: Computing methodologies Scene understanding Hongbin Lin, Yifan Jiang, Juangui Xu, Jesse J. Xu, Yi Lu, Zhengyu Hu, Ying-Cong Chen, Hao Wang Abstract . 3D point cloud segmentation aims to assign semantic labels to individual points in a scene for fine-grained spatial understanding. Existing methods typically adopt data augmentation to alleviate the burden of large-scale annotation. However, most augmentation strategies only focus on local transformations or semantic recomposition, lacking the consideration of global structural dependencies within scenes. To address this limitation, we propose a graph-guided data augmentation framework with dual-level constraints for realistic 3D scene synthesis. Our method learns object relationship statistics from real-world data to construct guiding graphs for scene generation. Local-level constraints enforce geometric plausibility and semantic consistency between objects, while global-level constraints maintain the topological structure of the scene by aligning the generated layout with the guiding graph. Extensive experiments on indoor and outdoor datasets demonstrate that our framework generates diverse and high-quality augmented scenes, leading to consistent improvements in point cloud segmentation performance across various models. Code is available at: https://github.com/alexander7xu/DualLevelAug 1. Introduction Figure 1. Single-Level Augmentation vs. Dual-Level Augmentation. Traditional approaches (left) typically operate at the local level. They either apply simple geometric transformations, such as rotation and scaling. Or they perform semantic-level manipulations by inserting copied objects into contextually reasonable locations. In contrast, our method (right) combines both local and global constraints, while also enabling cross-scene object integration. By modeling the scene as a graph, our method supports more complex and high-quality scene rearrangements, enhancing diversity and semantic coherence in synthesized point cloud data. Point cloud segmentation, which aims to assign semantic or instance labels to each 3D point in a scene, is a fundamental task in 3D scene understanding. It is crucial in numerous applications such as robotic navigation, augmented reality, autonomous driving, and digital twin systems ( Qi et al. 2017a ; Guo et al. 2020 ; Ma et al. 2019 ) . Recent advancements leverage transformer architectures, graph-based reasoning, and multi-modal fusion to enhance segmentation performance further ( Khan et al. 2022 ; Zhao et al. 2021 ; Sarker et al. 2024 ) . Despite these successes, existing methods rely heavily on large-scale annotated datasets, which are costly to acquire and label, posing a bottleneck for further progress ( Xiao et al. 2024 ; Li et al. 2022 ; Hu et al. 2024 ; Hu et al. 2023 ) . Real-world 3D scenes, whether indoor environments or outdoor streetscapes, exhibit complex spatial arrangements of objects. These arrangements are not random but follow intricate underlying distributions governed by physical laws, functional requirements, semantic context, and common usage patterns—such as vehicles on roads or furniture in rooms ( Armeni et al. 2016 ; Dai et al. 2017 ; Hu et al. 2020 ; Wijayathunga et al. 2023 ) . Learning these distributions is essential for robust scene understanding, especially in tasks like point cloud segmentation. However, due to the high cost of acquiring and annotating large-scale 3D datasets, models often suffer from limited exposure to diverse spatial configurations. Data augmentation is widely adopted to mitigate this limitation, enrich training data, and improve generalization. However, a key challenge remains: How to ensure that the augmented samples align with the structural and semantic constraints observed in real-world environments? Without such constraints, synthesized data may introduce unrealistic object arrangements or implausible spatial relationships, which can mislead the model and hinder its performance when deployed in real scenarios ( Wang et al. 2024 ; Zhu et al. 2024 ) . Existing point cloud data augmentation techniques can be broadly classified into two categories: geometric-level and semantic-level methods. Geometric-level methods, such as rotation, scaling, and jittering ( Chen et al. 2020 ; Li et al. 2020 ; Nekrasov et al. 2021 ) , primarily introduce local perturbations. While useful, they typically fail to generate novel scene layouts and thus explore only a limited region of the underlying scene distribution. Semantic-level methods—including generative models ( Achlioptas et al. 2018 ; Yang et al. 2019 ; Lehner et al. 2022 ) and object insertion or replacement strategies ( Gong et al. 2022 ; Ren et al. 2022 ) —attempt to modify scene composition more globally. However, they face difficulties in maintaining semantic consistency and physical realism, producing configurations that lie outside the target distribution of valid scenes. A key limitation persists across these methods. They lack explicit mechanisms to handle the complex distributions inherent in real-world 3D data. Consequently, they fail to accurately model or rigorously enforce these crucial relational and geometric regularities. Moreover, both geometric-level and semantic-level methods predominantly focus on local constraints, without considering the global structural dependencies or topological relationships that are critical for realistic and coherent scene generation ( Kolbe and Donaubauer 2021 ) . To overcome these limitations, we propose a novel data augmentation framework that synthesizes realistic and diverse 3D point cloud scenes by enforcing dual-level constraints. Our method explicitly models object co-occurrence statistics and spatial relationships from real-world datasets to guide scene generation with both local and global structural coherence. We first construct abstract guiding graphs that encode the desired scene topology, where the node activation is regulated by Jensen-Shannon (JS) divergence ( Lin 1991 ) to ensure consistency with the object category distribution in the training data. Objects are then placed into the scene and refined through a constraint-driven optimization process. Local-level constraints enforce geometric plausibility and semantic consistency, such as collision avoidance and functional relationships, while global-level constraints preserve the overall scene structure by minimizing the Graph Global Constraint Loss (GGCL) between the generated graph and the guiding graph. This dual-level strategy enables the generation of high-quality augmented scenes that capture complex spatial dependencies, effectively enhancing model robustness for point cloud segmentation. The contributions of this work are summarized as follows: 1) A graph-guided synthesis framework that models object co-occurrence statistics and spatial relationships to generate diverse and semantically meaningful 3D scenes. 2) A dual-level constraint optimization strategy that enforces geometric and semantic consistency at the local level, while maintaining global topological regularity via graph structure alignment. 3) Extensive experimental validation demonstrating that our method significantly improves segmentation performance across indoor and outdoor datasets, outperforming conventional augmentation techniques. 2. Related work Point Cloud Segmentation. Point cloud segmentation, which aims to assign semantic or instance labels to 3D points, is a core task in 3D scene understanding with applications in robotics, autonomous driving, and digital twin systems ( Qi et al. 2017a ; Guo et al. 2020 ) . It can be broadly categorized into indoor and outdoor segmentation. Indoor segmentation methods typically operate on structured yet cluttered environments such as offices, homes, and classrooms, where object categories are diverse and spatial arrangements are irregular. Point-based models ( Qi et al. 2017b ; Qian et al. 2022 ; Thomas et al. 2019 ; Lei et al. 2020 ) extract local geometric features directly from raw point clouds. More recently, transformer-based models ( Lai et al. 2022 ; Zhou et al. 2020 ; Zhao et al. 2021 ; Wu et al. 2022 ; Wang 2023 ; Yang et al.