La La LiDAR: La rge-Scale La yout Generation from LiDAR Data

Youquan Liu, Lingdong Kong, Weidong Yang, Ao Liang, Runnan Chen, Ben Fei, Tongliang Liu · 2025

Read La La LiDAR: La rge-Scale La yout Generation from LiDAR Data by Youquan Liu, Lingdong Kong, Weidong Yang, Ao Liang, Runnan Chen, Ben Fei, Tongliang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03691.txt.

Introduction

Youquan Liu, Lingdong Kong, and their co-authors present La La LiDAR, a 2025 system that generates laser scan scenes from a layout the user controls. Realistic LiDAR data matter for self driving and robotics, and diffusion models can already fake them well. What they lack is control over where objects sit and how they relate, which safety testing needs.

Their framework first builds a scene graph layout with a diffusion process that respects relations between objects, then injects that layout into full scene generation. Two new data sets, built from public driving data with scene graphs added, support the training. New scoring metrics judge layout quality. Tests showed top performance in both layout synthesis and full LiDAR generation.

Catalog record

CREATORYouquan Liu, Lingdong Kong, Weidong Yang, Ao Liang, Runnan Chen, Ben Fei, Tongliang Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03691

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

La La LiDAR: La rge-Scale La yout Generation from LiDAR Data Youquan Liu, Lingdong Kong, Weidong Yang, Ao Liang, Runnan Chen, Ben Fei, Tongliang Liu Abstract Controllable generation of realistic LiDAR scenes is crucial for applications such as autonomous driving and robotics. While recent diffusion-based models achieve high-fidelity LiDAR generation, they lack explicit control over foreground objects and spatial relationships, limiting their usefulness for scenario simulation and safety validation. To address these limitations, we propose La rge-scale La yout-guided LiDAR generation model (“ La La LiDAR ”), a novel layout-guided generative framework that introduces semantic-enhanced scene graph diffusion with relation-aware contextual conditioning for structured LiDAR layout generation, followed by foreground-aware control injection for complete scene generation. This enables customizable control over object placement while ensuring spatial and semantic consistency. To support our structured LiDAR generation, we introduce Waymo-SG and nuScenes-SG, two large-scale LiDAR scene graph datasets, along with new evaluation metrics for layout synthesis. Extensive experiments demonstrate that La La LiDAR achieves state-of-the-art performance in both LiDAR generation and downstream perception tasks, establishing a new benchmark for controllable 3D scene generation. Figure 1: Motivation of customizable LiDAR scene generation from “ La La LiDAR ”. Our framework consists of three key stages : 1) LiDAR layout generation using scene graphs, where nodes represent objects and edges capture their spatial relationships; 2) foreground point cloud synthesis , either by retrieving from a database or by generating conditioned on layout parameters; and 3) foreground-conditioned scene generation , where synthesized foreground serves as conditioning to generate the complete scene with realistic environmental context. This hierarchical approach enables fine-grained control over foreground object placement while maintaining overall scene coherence. 1 Introduction Generating 3D scenes has emerged as a critical technology for a wide spectrum of real-world applications, including autonomous driving, AR/VR, and robotics ( Muhammad et al. 2022 ; Bian et al. 2025 ; Lee et al. 2024 ) . In particular, for autonomous driving systems, the quality, diversity, and controllability of 3D training data directly impact perception capabilities and generalization performance ( Wilson et al. 2022 ; Zheng et al. 2024 ; Xie et al. 2025 ) . Traditional data collection methods, however, face substantial limitations in terms of cost, scalability, and coverage of rare scenarios, making synthetic data generation an increasingly attractive alternative. Recent advancements in generative models, especially diffusion-based approaches ( Nichol and Dhariwal 2021 ; Rombach et al. 2022 ) , have demonstrated remarkable success in high-fidelity image synthesis. This progress has naturally extended to 3D representations, yielding promising results for LiDAR point cloud generation in driving scenarios ( Hu, Zhang, and Hu 2024 ; Nakashima and Kurazume 2021 ; Nunes et al. 2024 ; Ran, Guizilini, and Wang 2024 ; Zyrianov, Zhu, and Wang 2022 ) . Despite notable advances in unconditional LiDAR scene generation, current approaches suffer from a critical limitation: the lack of customizable control over foreground object composition and arrangement. This deficiency is particularly significant in autonomous driving scenarios, where foreground objects such as vehicles, pedestrians, and other traffic participants constitute only a small fraction (approximately 6.29\% , measured on nuScenes) of the total point cloud. Although these foreground elements are crucial for downstream perception tasks, existing methods like LiDARGen ( Zyrianov, Zhu, and Wang 2022 ) process foreground and background elements uniformly, offering minimal control over object placement and inter-object spatial relationships. This uniform treatment limits the applicability of these generative models for driving simulation and long-tail scenario synthesis. To address these limitations, we propose La La LiDAR (Large-scale Layout-guided LiDAR) as shown in Figure 1 , a novel framework for fine-grained controllable LiDAR scene generation that explicitly models spatial relationships between foreground objects through structured scene graph representations. Our approach comprises three main steps: 1) Structured layout generation: synthesizing LiDAR layouts via a scene graph-based diffusion model to ensure spatial and semantic coherence. 2) Foreground point cloud synthesis: retrieving or generating object-level point clouds conditioned on the layout. 3) Foreground-conditioned scene generation: leveraging the synthesized foreground as control signals to generate a complete LiDAR scene with realistic environmental context. By integrating graph-based spatial reasoning and diffusion-based generative modeling, our method enables fine-grained customization of scene composition while preserving the realism of large-scale LiDAR environments. The contributions of our work include: • We introduce La La LiDAR , a comprehensive LiDAR layout generation framework that leverages scene graphs to capture semantic and spatial relationships among foreground objects. This enables customizable scene composition while maintaining physical plausibility. • We propose a novel Foreground-aware Control Injector (FCI) that effectively bridges layout information with the scene generation process, ensuring accurate representation and spatial coherence of foreground elements within the broader environmental context. • We construct two large-scale LiDAR scene graph datasets, Waymo-SG and nuScenes-SG , along with specialized evaluation metrics tailored for LiDAR layout generation, establishing new benchmarks for future research in LiDAR layout synthesis. • Our analyses prove superior performance of our approach in LiDAR layout generation, LiDAR scene generation, and multiple downstream perception tasks, including LiDAR semantic segmentation, 3D object detection, and scene completion. Extensive experiments under diverse setups demonstrate that La La LiDAR not only produces high-fidelity scenes but also provides unprecedented control over scene composition. By explicitly modeling foreground objects and their relationships, our method addresses a critical need in the development and evaluation of autonomous driving systems, enabling the generation of more diverse, realistic, and controllable driving scenarios. 2 Related Work LiDAR Scene Generation. LiDARGen ( Zyrianov, Zhu, and Wang 2022 ) pioneered diffusion-based LiDAR generation using range and reflectance data. UltraLiDAR ( Xiong et al. 2023 ) integrates voxelized LiDAR point cloud with a VQ-VAE framework ( Van Den Oord, Vinyals et al. 2017 ) , thereby enabling efficient LiDAR data generation and completion. R2DM ( Nakashima and Kurazume 2024 ) improved generation quality with advanced denoising networks, while LiDM ( Ran, Guizilini, and Wang 2024 ) focused on preserving geometric structures. RangeLDM ( Hu, Zhang, and Hu 2024 ) emphasized real-time generation, and Text2LiDAR ( Wu et al. 2024 ) introduced text-guided synthesis for semantic control. However, existing methods treat foreground and background uniformly, limiting control over object placement and spatial relationships. To address this, we propose a layout-guided LiDAR generation framework for more controllable and diverse LiDAR scene generation. 3D Generation from Scene Layouts. While extensively studied in indoor environments, scene layout-based generation remains underexplored for outdoor settings. Methods like Graph-to-3D ( Dhamo et al. 2021 ) and CommonScenes ( Zhai et al. 2023 ) utilize scene graphs for spatially coherent room generation, while EchoScene ( Zhai et al. 2024 ) further improves layout consistency through information echo mechanisms. We introduce the first scene graph-based approach for outdoor LiDAR generation, explicitly modeling foreground objects and their spatial relationships while proposing tailored evaluation metrics for autonomous driving scenarios. Downstream Applications. LiDAR-based perception plays a crucial role in autonomous driving applications ( Li et al. 2022 ; Kong et al. 2023a ; Liu et al. 2024 ; Liu et al. 2023 ; Li et al. 2023 ) . For LiDAR semantic segmentation, methods like SPVCNN ( Tang et al. 2020 ) and MinkUNet ( Choy, Gwak, and Savarese 2019 ) leverage sparse convolutions, while semi-supervised approaches such as MeanTeacher ( Tarvainen and

Read the complete text