Controllable Generation of Large-Scale 3D Urban Layouts with Semantic and Structural Guidance DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing C

Mengyuan Niu, Xinxin Zhuo, Ruizhe Wang, Yuyue Huang, Junyan Yang, Qiao Wang · 2025

Read Controllable Generation of Large-Scale 3D Urban Layouts with Semantic and Structural Guidance DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing C by Mengyuan Niu, Xinxin Zhuo, Ruizhe Wang, Yuyue Huang, Junyan Yang, Qiao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-23804.txt.

Introduction

City models for planning and games need layouts that are large, valid, and easy to steer. Mengyuan Niu and 5 co-authors built a framework that generates 3D urban layouts under semantic and structural guidance. Image-based rivals give variety but break geometric continuity, while graph methods capture structure and miss parcel meaning. Their graph fuses geometry with semantic attributes, adds edge weights, and embeds building height, lifting 2D layouts into 3D form.

Users can steer results by editing semantic attributes directly. Experiments show the method produces valid, large-scale urban models. The authors offer it as a practical tool for data-driven planning and design work.

Catalog record

CREATORMengyuan Niu, Xinxin Zhuo, Ruizhe Wang, Yuyue Huang, Junyan Yang, Qiao Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-23804

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Controllable Generation of Large-Scale 3D Urban Layouts with Semantic and Structural Guidance DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Computer-aided design CCS: Computing methodologies Scene understanding Mengyuan Niu, Xinxin Zhuo, Ruizhe Wang, Yuyue Huang, Junyan Yang, Qiao Wang Abstract . Urban modeling is essential for city planning, scene synthesis, and gaming. Existing image-based methods generate diverse layouts but often lack geometric continuity and scalability, while graph-based methods capture structural relations yet overlook parcel semantics. We present a controllable framework for large-scale 3D vector urban layout generation, conditioned on both geometry and semantics. By fusing geometric and semantic attributes, introducing edge weights, and embedding building height in the graph, our method extends 2D layouts to realistic 3D structures. It also enables users to directly control the output by modifying semantic attributes. Experiments show that it produces valid, large-scale urban models, offering an effective tool for data-driven planning and design. (a) Given block boundary and landuse (b) Generated fundamental 3D Layout (c) Change landuse type of several blocks (d) New 3D layout within specific blocks Figure 1 . Foundational 3D city generation with geometry and semantic information. Our method generates realistic urban layouts given the block boundary and landuse type (Left Pair). Moreover, new functional urban layouts will be generated only with change of the landuse type within different regions (Right Pair). The colors of the blocks indicate distinct land-use categories, detailed in the upper diagram. there are four pics illustrating different content 1. Introduction City modeling has attracted sustained interest across domains such as computer graphics, urban planning, and game development ( Ebert et al. 2003 ; Cureton and Coulton 2023 ; Ghisleni 2023 ) . Cities are increasingly conceptualized as integrated systems comprising roads, buildings, water bodies, and vegetation. Among these, road networks delineate land parcels that form urban blocks—fundamental spatial units that structure urban form and function ( Shakibamanesh and Ebrahimi 2020 ; Gašparović et al. 2021 ) . Traditional procedural modeling approaches generate large-scale urban environments using rule-based grammars and templates ( Benes et al. 2011 ; Watson et al. 2008 ) . While effective for regular grid-aligned layouts, they struggle to accommodate irregular geometries and heterogeneous architectural styles. Recent data-driven methods address these limitations by leveraging deep generative models. Pix2Pix, for instance, conditions on road and parcel inputs to synthesize building distributions, though often with blurred boundaries ( Isola et al. 2017 ; Li et al. 2024 ) . Extensions such as ESGAN and CAIN-GAN improve output diversity and controllability ( Hamghalam [n. d.] ; Jiang et al. 2024 ) , while diffusion-based frameworks like Stable Diffusion and ControlNet enable layout generation from semantic maps or bird’s-eye-view (BEV) inputs ( Zhang and Agrawala 2023 ; Ye et al. 2024 ) . GeoDiffusion further encodes geographic primitives as textual prompts to synthesize high-fidelity BEV layouts ( Chen 2024 ) . Parallel to image-based approaches, vector-graph-based methods represent urban environments as graph-structured data ( Johnson and Kumar 2024 ) ( Lee and Zhang 2025 ) , enabling fine-grained control and semantic reasoning. LayoutVAE learns distributions over bounding boxes of buildings and roads via variational autoencoding ( Jyothi et al. 2019 ) . BlockPlanner encodes urban blocks as graphs with parcel-level nodes and adjacency edges, using graph neural networks to generate regular footprints ( Xu and Aliaga 2021 ) . GlobalMapper generalizes this to arbitrary polygonal parcels using graph attention networks, supporting conditional control over semantic and geometric attributes ( He and Aliaga 2023 ) . Complementary efforts have explored semantic-aware synthesis ( Kelly and Wonka 2018 ) , multi-modal integration of geometry and land use ( Biljecki et al. 2018 ) , and high-fidelity façade generation at the building level ( Li et al. 2021 ) . These developments underscore the need for scalable frameworks that unify geometric realism, semantic consistency, and topological coherence in urban layout generation. However, existing building layout optimization focuses on 2D planes and arranges parcels solely by shape, overlooking real-world attributes such as parcel scale, orientation, and semantic context. Image-based 3D city generation methods can produce high-fidelity local scenes but struggle to scale to large-area planning, maintain spatial continuity, and avoid pixel-induced jagged edges that contradict authentic urban design. Semantic maps and depth maps are often generated separately, failing to ensure consistent height and semantic alignment, and the outputs lack vector structure, limiting controllability and downstream editing. To address these challenges, we propose a unified framework which can generate diverse, controllable, and realistic urban layouts as foundational vector data. Our approach treats each building as an independent entity rather than a collection of pixels, inherently producing 3D vectorized outputs. By jointly modeling geometric and semantic factors in the generation process, we achieve more plausible and realistic layouts. Moreover, our framework can synthesize layouts at arbitrary scales from a single input—unbounded by image resolution—thereby preserving spatial continuity. To effectively represent and model urban blocks and their buildings, we first employ a unified graph representation of block–building relationships ( He and Aliaga 2023 ) . It’s noteworthy that we introduce an adaptive edge weights to enrich this structure and allow more efficient propagation of node features, based on our observation that buildings tend to align in grid-like rows parallel to parcel boundaries. Next, we abstract individual buildings as basic 3D solids defined by their footprint geometries and height profiles. Treating each building as an integrated unit ensures plausibility in the generated results. By adopting a Graph Attention Network (GAT) ( Veličković et al. 2018 ) as the backbone of our Conditional Variational Autoencoder (CVAE) ( Sohn et al. 2015 ) , the model learns height and layout patterns simultaneously, achieving 3D planning results that closely approximate real-world cities. Finally, we fuse parcel semantic labels and geometric attributes into a single conditional signal that supervises both the learning and the generation of urban layouts, ensuring that the outputs are reasonable and effective. In addition, our method supports user-driven edits of land use attributes to produce various planning proposals, and the resulting base vector models support immediate editing, rendering, detailed refinement, and seamless alignment with existing GIS datasets, greatly enhancing both usability and practical application.Our main contributions can be summarized as follows: • We propose a novel framework for generating city-scale building layouts conditioned on parcel geometric and semantic attributes. • We propose a strengthed graph representation that integrates row–column layout patterns into edge weights and fuses multiple parcel attributes as conditional inputs, yielding greater diversity and controllability. • We embed building height as a node feature to generate continuous, realistic, vector-based 3D urban building models at arbitrary scales. 2. Related Work 2.1. Urban Layout Generation Early research in urban layout generation predominantly relied on procedural modeling frameworks, leveraging shape grammars and production rules to encode hierarchical street networks and block structures ( Parish and Müller 2001 ; Müller et al. 2006 ; Weber et al. 2009 ) . These methods offer fine-grained control over stylistic variation but require labor-intensive rule-crafting and struggle to adapt automatically to diverse geographic contexts. To alleviate manual effort, hybrid and parametric approaches were introduced, combining exemplar-based optimization with user-driven templates to conform generated

Read the complete text