OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation
Youquan Liu, Weidong Yang, Ao Liang, Xiang Xu, Lingdong Kong, Yang Wu, Dekai Zhu, Xin Li · 2026
Read OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation by Youquan Liu, Weidong Yang, Ao Liang, Xiang Xu, Lingdong Kong, Yang Wu, Dekai Zhu, Xin Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13815.txt.
Introduction
Youquan Liu and eleven colleagues present OmniLiDAR, a unified text-tuned spread frame making LiDAR scans in a shared range-image form. It covers eight domains spanning adverse weather, sensor-setup changes and cross-platform capture. To train a single model over mixed domains, they present a Cross-Domain Training plan mixing domains within each mini-batch and using tuning to steer making. They further propose Cross-Domain Feature shaping catching headed links along azimuth and height axes. Tests show strong making truth and steady gains in later uses.
Catalog record
| CREATOR | Youquan Liu, Weidong Yang, Ao Liang, Xiang Xu, Lingdong Kong, Yang Wu, Dekai Zhu, Xin Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59011 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13815
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation Thanks: Y. Liu and W. Yang are with the College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China. L. Kong and A. Liang are with the School of Computing, Department of Computer Science, National University of Singapore, Singapore. X. Xu is with the College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China. D. Zhu is with the Technical University of Munich, Munich, Germany. Y. Wu is with Nanjing University of Science and Technology, Nanjing, China. X. Li is with Shanghai AI Laboratory, Shanghai, China. R. Chen and T. Liu are with the University of Sydney, Sydney, Australia. B. Fei and W. Ouyang are with The Chinese University of Hong Kong, Hong Kong SAR, China. W. Yang, B. Fei, and R. Chen are the corresponding authors. Youquan Liu, Weidong Yang, Ao Liang, Xiang Xu, Lingdong Kong, Yang Wu, Dekai Zhu, Xin Li Abstract LiDAR scene generation is increasingly important for scalable simulation and synthetic data creation, especially under diverse sensing conditions that are costly to capture at scale. Typically, diffusion-based LiDAR generators are developed under single-domain settings, requiring separate models for different datasets or sensing conditions and hindering unified, controllable synthesis under heterogeneous distribution shifts. To this end, we present OmniLiDAR , a unified text-conditioned diffusion framework that generates LiDAR scans in a shared range-image representation across eight representative domains spanning three shift types: adverse weather, sensor-configuration changes ( e.g. , reduced beams), and cross-platform acquisition (vehicle, drone, and quadruped). To enable training a single model over heterogeneous domains without isolating optimization by domain, we introduce a Cross-Domain Training Strategy (CDTS) that mixes domains within each mini-batch and leverages conditioning to steer generation. We further propose Cross-Domain Feature Modeling (CDFM) , which captures directional dependencies along azimuth and elevation axes to reflect the anisotropic scanning structure of range images, and Domain-Adaptive Feature Scaling (DAFS) as a lightweight modulation to account for structured domain-dependent feature shifts during denoising. In the absence of a public consolidated benchmark, we construct an 8-domain dataset by combining real-world scans with physically based weather simulation and systematic beam reduction while following official splits. Extensive experiments demonstrate strong generation fidelity and consistent gains in downstream use cases, including generative data augmentation for LiDAR semantic segmentation and 3D object detection, as well as robustness evaluation under corruptions, with consistent benefits in limited-label regimes. I Introduction Fig. 1 : OmniLiDAR in context: unified multi-domain LiDAR generation with a single text-conditioned diffusion model. (a) Prior diffusion-based LiDAR generators are typically developed under single-domain settings, i.e. , one model per dataset or a narrowly scoped variation axis ( e.g. , weather-only), which limits coverage and scalability. (b) OmniLiDAR trains a single generator over eight representative domains spanning three shift types: weather effects, sensor-configuration changes ( e.g. , beam reduction), and acquisition platforms (vehicle, drone, quadruped), and uses concise text prompts to select the target domain at inference. Right: example scans from the eight domains illustrating characteristic domain-specific patterns. LiDAR is a core sensing modality for autonomous driving and mobile robotics, providing accurate 3D geometry and being largely insensitive to illumination variations [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . In real-world deployment, however, LiDAR data exhibit pronounced distribution shifts caused by multiple factors, including adverse weather ( e.g. , fog, snow, rain, and wet ground), varying sensor configurations ( e.g. , beam count and vertical resolution), and different acquisition platforms ( e.g. , vehicles, aerial drones, and quadruped robots). These shifts induce structured changes in return statistics, sampling geometry, and point-density patterns [ 8 , 9 , 10 , 11 , 12 , 13 , 14 ] . Since many such conditions are infrequent and costly to capture with dense annotations [ 15 , 16 , 17 ] , scalable LiDAR generative modeling is increasingly attractive for simulation and synthetic data creation. Among generative models, diffusion-based LiDAR generation methods [ 18 , 19 , 20 , 21 , 22 ] have achieved strong fidelity, but they are typically developed under single-domain settings: both training and evaluation are confined to a single dataset or a narrowly scoped condition set ( e.g. , a small weather subset), as illustrated in Figure 1 (a). In practice, extending such generators to heterogeneous sensing scenarios often requires training separate models for different domains or restricting the scope of variation to maintain quality [ 23 , 24 ] . This paradigm not only scales poorly as the number of target domains grows, but also complicates model maintenance, deployment, and fair cross-domain comparison [ 25 , 26 , 27 , 28 ] . More importantly, it prevents a single controllable generator from leveraging LiDAR geometric priors and scanning regularities shared across domains. A central question therefore remains: Can a single generative model cover heterogeneous LiDAR domains induced by weather, sensor, and platform shifts, while maintaining explicit controllability over the target domain? Building such a unified generator is non-trivial. First, the domain gaps are inherently structured: adverse weather introduces condition-dependent attenuation and dropout patterns, reduced-beam sensors modify the angular sampling lattice, and cross-platform acquisition alters viewpoints and occlusion statistics [ 29 , 12 , 8 , 30 , 31 , 32 ] . Second, unified training must learn cross-domain shared representations while preserving domain-specific characteristics [ 33 , 12 , 34 , 35 , 36 ] . Domain-homogeneous mini-batches restrict cross-domain interaction during optimization, limiting the learning of representations shared across domains that are required for a single controllable generator. Conversely, indiscriminate domain mixing can introduce interference across heterogeneous statistics, degrading the model’s ability to preserve domain-specific structures. A unified model must therefore learn geometry-aligned structure shared across domains, accommodate domain-dependent statistics, and enable reliable domain control within a single generative process. To address these challenges, we propose OmniLiDAR , a unified, text-conditioned diffusion framework for controllable LiDAR generation across heterogeneous domains. OmniLiDAR operates on a shared range-image representation that respects spinning-LiDAR acquisition geometry and provides a consistent modeling space across domains. Concise text descriptors serve as compact domain-level conditioning signals to specify the desired domain. This design targets descriptor-conditioned domain control rather than open-vocabulary language supervision. We introduce a Cross-Domain Training Strategy (CDTS) that constructs mixed-domain mini-batches to strengthen cross-domain interaction while relying on conditioning to steer domain-specific generation. In addition, OmniLiDAR incorporates Cross-Domain Feature Modeling (CDFM) to model geometry-aligned long-range dependencies shared across domains along the azimuth and elevation axes, and Domain-Adaptive Feature Scaling (DAFS) as a lightweight modulation to calibrate domain-dependent statistics during denoising. Training and evaluating a single generator across heterogeneous domains requires a unified multi-domain benchmark. However, existing public LiDAR datasets [ 37 , 15 , 12 , 9 , 38 ] each cover only a subset of the above factors and are not designed for unified multi-domain generation under a consistent protocol. To bridge this gap, we construct an eight-domain LiDAR dataset that spans three domain shift types : • Cross-platform clean domains (vehicle, drone, and quadruped) from public benchmarks [ 37 , 12 ] . • Controlled weather-induced degradations generated via physically based simulation [ 8 , 39 ] . • Systematic beam reduction implemented by deterministic subsampling