TreeON: Reconstructing 3D Tree Point Clouds from Orthophotos and Heightmaps
Angeliki Grammatikaki , Johannes Eschner , Pedro Hermosilla , Oscar Argudo , Manuela Waldner, [6pt] TU Wien, Institute of Visual Computing and Human-Centered Technology, Vienna, Austria VRVis GmbH, Vienna, Austria Universitat Politècnica de Catalunya, Department of Computer Science, Barcelona, Spain · 2026
Read TreeON: Reconstructing 3D Tree Point Clouds from Orthophotos and Heightmaps by Angeliki Grammatikaki , Johannes Eschner , Pedro Hermosilla , Oscar Argudo , Manuela Waldner, [6pt] TU Wien, Institute of Visual Computing and Human-Centered Technology, Vienna, Austria VRVis GmbH, Vienna, Austria Universitat Politècnica de Catalunya, Department of Computer Science, Barcelona, Spain (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10996.txt.
Introduction
Angeliki Grammatikaki and coauthors present TreeON. This neural framework rebuilds detailed three-dimensional tree point clouds. It uses just a single top-down orthophoto and its digital surface model. Training leans on a synthetic dataset of procedurally modeled trees. It uses geometric supervision plus differentiable shadow and silhouette losses. It needs no species labels or ground laser scans. Experiments show better reconstruction quality and coverage than existing methods. They show strong generalization to real-world data. The work is suited to interactive digital maps.
Catalog record
| CREATOR | Angeliki Grammatikaki , Johannes Eschner , Pedro Hermosilla , Oscar Argudo , Manuela Waldner, [6pt] TU Wien, Institute of Visual Computing and Human-Centered Technology, Vienna, Austria VRVis GmbH, Vienna, Austria Universitat Politècnica de Catalunya, Department of Computer Science, Barcelona, Spain |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56429 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10996
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TreeON: Reconstructing 3D Tree Point Clouds from Orthophotos and Heightmaps Angeliki Grammatikaki , Johannes Eschner , Pedro Hermosilla , Oscar Argudo , Manuela Waldner, [6pt] TU Wien, Institute of Visual Computing and Human-Centered Technology, Vienna, Austria VRVis GmbH, Vienna, Austria Universitat Politècnica de Catalunya, Department of Computer Science, Barcelona, Spain Abstract We present TreeON, a novel neural-based framework for reconstructing detailed 3D tree point clouds from sparse top-down geodata, using only a single orthophoto and its corresponding Digital Surface Model (DSM). Our method introduces a new training supervision strategy that combines both geometric supervision and differentiable shadow and silhouette losses to learn point cloud representations of trees without requiring species labels, procedural rules, terrestrial reconstruction data, or ground laser scans. To address the lack of ground truth data, we generate a synthetic dataset of point clouds from procedurally modeled trees and train our network on it. Quantitative and qualitative experiments demonstrate better reconstruction quality and coverage compared to existing methods, as well as strong generalization to real-world data, producing visually appealing and structurally plausible tree point cloud representations suitable for integration into interactive digital 3D maps. The codebase, synthetic dataset, and pretrained model are publicly available at https://angelikigram.github.io/treeON/ . Figure 1 : Our neural-based framework, TreeON, reconstructs coherent tree point clouds for trees in real datasets using only an orthophoto and a Digital Surface Model (DSM). 1 Introduction Digital 3D maps are widely used to communicate spatial and environmental information, offering intuitive and immersive representations of real landscapes [ 54 ] . Unlike urban settings, where terrestrial scans [ 7 ] or multi-view photogrammetry [ 57 ] are often used to generate detailed 3D models, high-resolution datasets remain limited or region-specific in natural environments. In rural areas, digital 3D maps are therefore mostly generated from aerial imagery, including orthophotos combined with Digital Surface Models (DSMs; raster heightmaps encoding terrain elevation and above-ground objects such as vegetation and buildings).. As a result, rural 3D maps are, in fact, often limited to a 2.5D surface representation, which lacks detail in close-up oblique views. This limitation is most evident for vegetation, where fine structural detail is lost (see Figure 1 left) , which is perceived as non-appealing [ 18 ] . We hypothesize that much of the missing 3D information for vegetation, especially for isolated trees, can be inferred from the currently available 2.5D inputs. This would enable lightweight yet visually appealing reconstructions without requiring additional data collection. Such an approach could address a key design dilemma: how can we create tree models that are both visually compelling and computationally lightweight, and hence scalable enough for large outdoor environments, and effective in data-sparse conditions? This hypothesis is motivated by findings from studies in virtual environments, which show that trees with distinctive shapes not only improve perceived realism but also facilitate orientation and wayfinding, particularly when they serve as recognizable landmarks [ 31 ] . Just as buildings and monuments serve as key reference points in urban navigation, trees can provide essential visual anchors in natural terrain. Although simplified vegetation can still serve as landmarks, prior work shows that users strongly prefer the visual appeal of more detailed models and perceive them as more reliable for navigation [ 18 ] . Prior methods for vegetation reconstruction have relied on data-rich techniques involving dense LiDAR point clouds [ 69 , 13 ] , multi-view terrestrial or aerial imagery [ 56 , 29 , 72 , 25 ] , photogrammetry and remote sensing approaches [ 11 ] , or biologically-inspired procedural modeling based on species-specific rules [ 70 ] . While these approaches can produce structurally detailed results, they tend to be computationally expensive, difficult to scale, and reliant on specialized data collection. Consequently, they are ill-suited for wide-area deployment in natural landscapes, where acquiring such detailed datasets is often infeasible. This motivates the need for lightweight, scalable solutions that can generate realistic vegetation models from standard geodata sources alone. An ideal method for large-scale rural maps should satisfy several requirements: (1) high visual appeal in close-up oblique views, (2) computational efficiency for large-scale deployment (particularly for rendering), (3) structural plausibility for different tree types, and (4) automation without the need for additional input data, like species information, photographs, or user sketches. These requirements reveal why existing methods fall short: some achieve realism but are inefficient or data-hungry, while others are lightweight yet lack plausibility. To fill this gap, we propose a novel approach that reconstructs visually plausible 3D tree point clouds from sparse geodata by exploiting multiple complementary cues present in DSMs and orthophotos. These cues include canopy shape, overall height, and height-to-width ratio from the DSM, as well as canopy texture and shadows from the orthophoto. Our pipeline constructs a 3D point cloud representation of each tree from a single orthophoto and its corresponding DSM. We adopt a point cloud output as a pragmatic, generator-agnostic representation for large-scale 3D mapping, avoiding inference of parameters tied to a specific procedural model, while still allowing higher-level structure to be recovered from the point cloud when needed (TreeStructor [ 77 ] ). Our method integrates geometric and visual cues via a PointNet-style terrain encoder and a CNN-based orthophoto encoder, with a neural decoder predicting occupancy at arbitrary 3D query points. The training process is supervised through five complementary loss terms: a binary cross-entropy loss to enforce structural plausibility, a color consistency loss to match orthophoto appearance, and three differentiable perceptual losses [ 74 ] that supervise alignment with observed shadows, and top and side view silhouettes. This multi-modal supervision enables the model to infer plausible and expressive tree shapes, yielding realistic reconstructions in environments where more detailed 3D data is unavailable. In summary, our work makes three main contributions: 1. A synthetic dataset of procedurally generated trees with paired orthophotos and DSMs, 2. A network architecture for reconstructing detailed 3D tree point clouds from sparse top-down geospatial data, and 3. A training supervision strategy that combines occupancy prediction with shadow- and silhouette-based losses. In addition, we demonstrate through quantitative and qualitative evaluation that, with these contributions, our approach fulfills the requirements of realistic and visually appealing tree reconstruction better than alternative architectures and supervision strategies. 2 Related Work Modeling realistic trees has been central to both computer graphics and remote sensing. Traditional methods often depend on dense 3D terrestrial laser scans to extract explicit branch skeletons and generate foliage-rich models [ 69 ] . However, such data are typically unavailable in remote or rural areas, where only orthophotos and elevation models exist. These methods satisfy structural plausibility and visual appeal, but fail scalability and automation due to costly data acquisition. To overcome the need for rich input data, researchers have explored multi-view image reconstructions, including volumetric and point cloud assemblies [ 56 , 8 ] , and sketch-based techniques requiring user guidance [ 61 ] . Argudo et al. [ 3 ] developed a single-image method to infer plausible structure, but it struggles under significant occlusion. All these approaches either rely on multi-view imagery or human intervention, limiting scalability to large, sparsely mapped landscapes. Thus, while they improve realism, they fall short in efficiency and automation. Procedural generation synthesizes tree forms from parametric or stochastic growth models