UE5-Forest: A Photorealistic Synthetic Stereo Dataset for UAV Forestry Depth Estimation
Yida Lin, Bing Xue, Mengjie Zhang, Sam Schofield, Richard Green · 2026
Read UE5-Forest: A Photorealistic Synthetic Stereo Dataset for UAV Forestry Depth Estimation by Yida Lin, Bing Xue, Mengjie Zhang, Sam Schofield, Richard Green (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15304.txt.
Introduction
Lin and co-authors release UE5-Forest, a photorealistic synthetic stereo dataset for depth estimation in forests. Real disparity ground truth is nearly impossible to gather among thin, tangled branches. The set renders 115 scanned trees from the Quixel Megascans library inside Unreal Engine 5. A virtual stereo rig copies the ZED Mini camera on their drone. Orbits at three heights yield 5,520 rectified stereo pairs at full HD, each with pixel-perfect disparity labels. Comparisons with real Canterbury branch photos support the realism of the renders.
Catalog record
| CREATOR | Yida Lin, Bing Xue, Mengjie Zhang, Sam Schofield, Richard Green |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20488 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15304
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UE5-Forest: A Photorealistic Synthetic Stereo Dataset for UAV Forestry Depth Estimation Yida Lin, Bing Xue, Mengjie Zhang, Sam Schofield, Richard Green Abstract Dense ground-truth disparity maps are practically unobtainable in forestry environments, where thin overlapping branches and complex canopy geometry defeat conventional depth sensors—a critical bottleneck for training supervised stereo matching networks for autonomous UAV-based pruning. We present UE5-Forest , a photorealistic synthetic stereo dataset built entirely in Unreal Engine 5 (UE5). One hundred and fifteen photogrammetry-scanned trees from the Quixel Megascans library are placed in virtual scenes and captured by a simulated stereo rig whose intrinsics—63 mm baseline, 2.8 mm focal length, 3.84 mm sensor width—replicate the ZED Mini camera mounted on our drone. Orbiting each tree at up to 2 m across three elevation bands (horizontal, + 45 ∘ +45^{\circ} , − 45 ∘ -45^{\circ} ) yields 5,520 rectified 1920 × 1080 1920\times 1080 stereo pairs with pixel-perfect disparity labels. We provide a statistical characterisation of the dataset—covering disparity distributions, scene diversity, and visual fidelity—and a qualitative comparison with real-world Canterbury Tree Branches imagery that confirms the photorealistic quality and geometric plausibility of the rendered data. The dataset will be publicly released to provide the community with a ready-to-use benchmark and training resource for stereo-based forestry depth estimation. I Introduction Supervised stereo matching networks depend on dense disparity ground truth, yet collecting such labels outside controlled settings remains an unresolved challenge. Forest canopies present an extreme instance of this problem: thin overlapping branches, dense foliage, and irregular geometry prevent reliable depth acquisition by either LiDAR [ 13 ] or structured-light sensors [ 14 ] . The resulting data vacuum directly constrains UAV-based autonomous pruning [ 1 , 2 ] , an application that demands centimetre-level depth precision at 1–2 m working distances for safe tool positioning around radiata pine ( Pinus radiata )—New Zealand’s dominant plantation species, underpinning an NZ$3.6 billion forestry sector. A common workaround is to treat the output of a strong foundation model as pseudo-ground truth [ 3 , 4 ] , but teacher-model errors propagate directly into every student, imposing an accuracy ceiling that cannot be verified in the field. Game-engine simulation offers a structurally different solution. Unreal Engine 5 (UE5), with its Lumen global illumination and Nanite micro-polygon geometry [ 18 ] , now produces imagery approaching photographic realism; at the same time, its per-pixel depth buffer delivers mathematically exact disparity. Pairing this rendering capability with the Quixel Megascans library [ 16 ] —115 photogrammetry-scanned tree models covering a wide spectrum of species and growth forms—enables the synthesis of forestry-specific data that is both visually authentic and label-perfect. Despite these technological advances, no publicly available stereo dataset targets the forestry domain with dense, error-free disparity labels. Existing synthetic benchmarks such as Scene Flow [ 6 ] , SYNTHIA [ 21 ] , and Playing for Data [ 22 ] focus on urban driving scenarios and lack the fine-grained vegetation geometry that characterises forest scenes. This gap motivates the creation of a dedicated resource. In this paper we introduce UE5-Forest , a synthetic stereo dataset designed specifically for UAV forestry depth estimation. A simulated drone-mounted stereo rig orbits each of the 115 trees at up to 2 m, with optical parameters—63 mm baseline, 2.8 mm focal length, 3.84 mm sensor width—identical to the ZED Mini [ 17 ] installed on our UAV. Three elevation rings of 16 viewpoints each ( 0^{\circ} , +45^{\circ} , -45^{\circ} ) yield 5,520 stereo pairs at 1920\times 1080 with pixel-perfect disparity maps. The principal contributions are threefold: • A photorealistic forestry stereo dataset with pixel-accurate disparity labels, generated in UE5 from 115 photogrammetry-scanned tree assets under camera parameters precisely matched to real ZED Mini hardware. • A detailed statistical characterisation of the dataset, including disparity range analysis, scene diversity metrics, and a qualitative visual comparison with real-world Canterbury Tree Branches imagery that confirms the photorealistic quality of the rendered data. • A publicly released, ready-to-use benchmark and training resource that fills the data vacuum for supervised stereo matching research in the forestry domain. II Related Work II-A UAV-Based Depth Estimation in Forestry Stereo cameras have served as primary depth sensors on UAV platforms across diverse outdoor tasks, from visual navigation [ 24 ] and 3D terrain reconstruction [ 25 ] to high-speed obstacle avoidance [ 26 ] . Within forestry, TIMBERVision [ 2 ] deployed stereo depth for stand-level canopy monitoring, while integrated branch detection [ 1 , 27 ] and segmentation [ 28 ] pipelines couple disparity output with object recognition for pruning automation. A recent benchmark [ 3 ] evaluated seven stereo methods on vegetation imagery but was bound to pseudo-ground truth from the DEFOM foundation model [ 4 ] , underscoring the persistent absence of reliable reference data in this domain. II-B Stereo Matching and the Need for Dense Labels Stereo matching architectures—from cost-volume methods [ 15 , 8 , 9 ] to iterative refinement designs such as RAFT-Stereo [ 7 ] and IGEV-Stereo [ 5 ] —have achieved impressive accuracy on established benchmarks. Lightweight variants [ 12 , 11 ] and attention-based approaches [ 10 ] extend the design space further. Yet every supervised architecture depends on dense disparity labels for training—labels that remain scarce for natural vegetation scenes. This data bottleneck, rather than architectural limitations, is the primary obstacle to deploying stereo networks in forestry. II-C Synthetic Datasets for Depth Estimation Synthetic data has proven indispensable for stereo research. The Scene Flow dataset [ 6 ] —rendered urban scenes with exact disparity—remains the standard pre-training corpus. Large-scale game-engine datasets such as SYNTHIA [ 21 ] and Playing for Data [ 22 ] demonstrated that photorealistic renders transfer well to autonomous-driving perception. Domain randomisation [ 19 ] and domain-invariant feature learning [ 20 ] further narrow the sim-to-real gap. Two recent developments make this strategy particularly attractive for forestry. First, UE5’s Nanite and Lumen systems [ 18 ] render high-polygon vegetation with physically based lighting at interactive rates. Second, the Quixel Megascans library [ 16 ] supplies photogrammetry-scanned tree assets that preserve authentic bark textures, leaf geometry, and branch topology. However, no prior work has harnessed these resources to construct a stereo dataset tailored to forestry. Table I positions UE5-Forest relative to existing synthetic stereo benchmarks. TABLE I : Comparison of UE5-Forest with existing synthetic stereo datasets. Dataset Pairs Resolution Domain Labels Scene Flow [ 6 ] 39,049 960\times 540 Urban Disparity, flow SYNTHIA [ 21 ] 213,400 1280\times 760 Urban Depth, seg. Playing for Data [ 22 ] 24,966 1914\times 1052 Urban Seg. UE5-Forest (ours) 5,520 \mathbf{1920\times 1080} Forestry Disparity III Dataset Construction III-A Overview The dataset generation pipeline, illustrated in Fig. 1 , proceeds in three stages: (1) photogrammetry-scanned tree assets are imported into UE5; (2) a simulated stereo camera orbits each tree under controlled lighting; and (3) RGB image pairs together with per-pixel depth maps are exported and converted into disparity ground truth. Fig. 1 : Overview of the UE5-Forest dataset generation pipeline. III-B Stereo Geometry and Camera Model Given a rectified stereo pair I_{L},I_{R}\in\mathbb{R}^{H\times W\times 3} , stereo matching estimates a disparity map D\in\mathbb{R}^{H\times W} where each pixel (x,y) in the left image corresponds to (x-D(x,y),\,y) in the right image. Depth