Texture2LoD3: Enabling LoD3 Building Reconstruction With Panoramic Images
Wenzhao Tang, Weihang Li, Xiucheng Liang, Olaf Wysocki, Filip Biljecki, Christoph Holst, Boris Jutzi · 2025
Read Texture2LoD3: Enabling LoD3 Building Reconstruction With Panoramic Images by Wenzhao Tang, Weihang Li, Xiucheng Liang, Olaf Wysocki, Filip Biljecki, Christoph Holst, Boris Jutzi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05249.txt.
Introduction
Wenzhao Tang and co-authors present Texture2LoD3, a 2025 method that rebuilds detailed building models from street panoramas. City models at the finest detail level need watertight shapes, tagged facades, and few polygons. Hand building them is slow, and plain photo meshes break those rules.
Their trick leans on the rough building models cities already have. Each flat face of a rough model becomes a target for flattening the matching panorama view. Running segmentation on those flat, true-scale textures keeps the model's clean geometry while adding facade detail. On their new ReLoD3 test set, facade segmentation accuracy rose by 11 percent. The pipeline could spread detailed city models widely, aiding solar estimates and driving simulators alike.
Catalog record
| CREATOR | Wenzhao Tang, Weihang Li, Xiucheng Liang, Olaf Wysocki, Filip Biljecki, Christoph Holst, Boris Jutzi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05249
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Texture2LoD3: Enabling LoD3 Building Reconstruction With Panoramic Images Wenzhao Tang, Weihang Li, Xiucheng Liang, Olaf Wysocki, Filip Biljecki, Christoph Holst, Boris Jutzi Abstract Despite recent advancements in surface reconstruction, Level of Detail (LoD) 3 building reconstruction remains an unresolved challenge. The main issue pertains to the object-oriented modelling paradigm, which requires georeferencing, watertight geometry, facade semantics, and low-poly representation – Contrasting unstructured mesh-oriented models. In Texture2LoD3, we introduce a novel method leveraging the ubiquity of 3D building model priors and panoramic street-level images, enabling the reconstruction of LoD3 building models. We observe that prior low-detail building models can serve as valid planar targets for ortho-rectifying street-level panoramic images. Moreover, deploying segmentation on accurately textured low-level building surfaces supports maintaining essential georeferencing, watertight geometry, and low-poly representation for LoD3 reconstruction. In the absence of LoD3 validation data, we additionally introduce the ReLoD3 dataset, on which we experimentally demonstrate that our method leads to improved facade segmentation accuracy by 11% and can replace costly manual projections. We believe that Texture2LoD3 can scale the adoption of LoD3 models, opening applications in estimating building solar potential or enhancing autonomous driving simulations. The project website, code, and data are available here: https://wenzhaotang.github.io/Texture2LoD3/ . 1 Introduction Figure 1 : Texture2LoD3 proposes leveraging ubiquitous street-level images and low-level building models for accurate ortho-texturing (left): Enabling accurate semantic segmentation (center) and facade-rich LoD 3 reconstruction (right). Photogrammetry and computer vision researchers have always seen detailed semantic 3D building reconstruction as a fundamental challenge [ 50 , 17 ] . Recent developments in open source and proprietary software have shown that reconstruction using 2D building footprints and aerial observations enables country-wide reconstruction up to the LoD 2 displaying complex roof shapes and simplified facades [ 46 , 17 , 60 ] . Unlike the mesh-oriented models, the semantic 3D building models defined by the international CityGML standard [ 15 ] are georeferenced, watertight, and have low-poly boundary representation (B-Rep), enabling multiple applications [ 4 ] . Remarkably, such models remain under-explored modality for methods development, given their ubiquity, e.g., open data on 215 million buildings in Switzerland, the Netherlands, the US, or Poland [ 60 , 61 ] . Unlike low-detail LoD 1 and LoD 2, LoD 3 models are characterized by additional detailed facade representation and remain scarcely available despite novel methods presence [ 59 , 39 , 24 , 21 , 57 ] . One of the main issues pertains to the source data availability, assuming either accurate mobile laser scanning (MLS) observations or ortho-rectified textures, which in practice are often unavailable. Despite worldwide availability of panoramic street-level images such as Google Street View (GSV) or Mapillary [ 23 ] and the growth in image-based training datasets, facade elements remain frequently unlabeled and limited to ortho-rectified image views [ 57 , 59 , 56 , 29 ] . Applying such training sets to perspective and panoramic images remains unfeasible due to drastic geometry representation changes in facade elements, e.g., the closer rectangular windows are to the vanishing point, the more they resemble lines. As we exemplify in Fig. 1 , our Texture2LoD3 proposes a method harnessing the potential of widely available panoramic street-view images and ubiquitous low-level semantic 3D building models. We leverage the georeferencing of two modalities for their global matching while low-poly planar representation of 3D models for the image ortho-rectification target. By utilizing prior low-poly models, we satisfy requirements of georeferencing, watertightness, low-poly representation, and geometrical consistency for LoD 3 reconstruction: Formulating it as a refinement strategy [ 59 ] of low-level models to high-detail LoD 3 models by reconstructing only the required facade elements, segmented from a projected image onto a planar surface. Our main contributions are as follows: • We propose the effective projection of panoramic images to ortho-rectified images by leveraging ubiquitous semantic 3D building models as targets • We improve facade semantic segmentation performance on 3D surfaces by accurate texturing: Enabling accurate LoD 3 facade element reconstruction • We introduce the first-of-its-kind open texturing benchmark dataset, ReLoD3, comprising synchronised LoD 3 models, panoramic images, and manually textured low-level LoD 2 building models 2 Related Works 3D Facade Segmentation The recent years have witnessed a surge in semantic 3D facade segmentation methods both on point clouds, images, and in combination with prior 3D models. Since the current research suggests that street-level and drone-based point clouds accurately depict 3D facade geometry, multiple point-cloud-based methods have been proposed [ 40 , 35 , 52 , 14 ] . Recent benchmark data results, such as ZAHA [ 62 ] and ArCH [ 35 ] , imply that the challenge is still unsolved and remains challenging due to under-represented classes, sparsity of objects in point clouds, and frequently indistinct 3D geometry features [ 49 , 45 ] . Other approaches rely only on image-based input, capitalizing on rich optical features and 2D image grid representation. Various methods have been proposed to tackle this challenge, such as non-learning [ 50 , 37 ] , gramma-based [ 36 , 5 ] , and recently deep learning approaches [ 32 , 20 , 24 , 57 , 7 ] . Owing to the ubiquity of image training data, even the standard Mask-RCNN [ 19 ] proves relatively efficient after the subsequent fine-tunning on the facade image databases [ 59 ] . However, these methods perform well only under the assumption that an image is ortho-rectified; it makes generalization challenging since facade elements are prone to the dire geometry change under perspective and barrel distortions. This applies to classical methods as well which explicitly concentrate on line and point extraction for matching images with models for texturing [ 26 , 51 , 25 , 22 ] . In practice, ortho-rectified images are rare and limited just to a few benchmarks or manual projections, yielding unsatisfactory results on non-rectified real-world data [ 6 , 56 , 29 , 11 , 44 , 27 ] . An alternative approach is to exploit information from 3D models, optical images, and laser scanning point clouds to achieve accurate 3D facade segmentation [ 55 , 59 ] . For example, Scan2LoD3 [ 59 ] introduces a method where uncertainty-aware ray analysis of laser points with 3D models yield conflict maps indicating openings, which can serve as evidence for late-fusion of 3D segmented point clouds and 2D segmented optical images. However, the availability of such multi-modal setups is currently limited and assumes their heterogeneous accurate projection onto the model surface. LoD3 Building Reconstruction Semantic 3D building reconstruction is a long-standing challenge in photogrammetry and computer vision [ 50 ] . For years, the international standard CityGML [ 16 , 3 ] has been defining the formal description of such models, where LoD 1 stands for simple cuboid models, LoD 2 for polyhedral models with detailed roof shape, and LoD 3 for detailed roof shapes complemented with a detailed facade representation. The primary difference to the standard mesh models is that semantic 3D building models are georeferenced; comprise object-level geometry and semantics; have a hierarchical data model that also describes the object-to-object relationship; display watertight and low-poly geometry facilitating volumetric space interpretation by integrating externally observable surfaces within a boundary representation (B-Rep) [ 28 , 16