HetScene : Het erogeneity-Aware Diffusion for Dense Indoor Scene Generation
Zini Chen, Junming Huang, Rong Zhang · 2026
Read HetScene : Het erogeneity-Aware Diffusion for Dense Indoor Scene Generation by Zini Chen, Junming Huang, Rong Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13586.txt.
Introduction
Zini Chen and six colleagues propose HetScene, a heterogeneity-aware diffusion framework for dense indoor scene generation. The authors revisit layout generation through structural heterogeneity, splitting objects into primary and minor kinds by their own roles in a scene. HetScene splits layout work into two stages: Structural Layout Generation and Contextual Layout Generation. The first stage builds tidy layouts from primary objects only, guided by text notes, room masks and spatial link graphs.
Catalog record
| CREATOR | Zini Chen, Junming Huang, Rong Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34894 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13586
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HetScene : Het erogeneity-Aware Diffusion for Dense Indoor Scene Generation Zini Chen, Junming Huang, Rong Zhang Abstract Generating controllable and physically plausible indoor scenes is a pivotal prerequisite for constructing high-fidelity simulation environments for embodied AI. However, existing deep learning-based methods usually treat all objects as homogeneous instances within a unified generation process. While effective for sparse and simplistic layouts, they struggle to model realistic layouts with dense object arrangements and complex spatial dependencies, leading to limited scalability and degraded physical plausibility. To deal with these challenges, we revisit indoor layout generation from the perspective of structural heterogeneity and decompose the objects into primary objects and secondary objects according to their distinct roles in shaping a scene. Based on this decomposition, we propose HetScene , a heterogeneous two-stage generation framework that decouples indoor layout synthesis into Structural Layout Generation (SLG) and Contextual Layout Generation (CLG). SLG first generates globally coherent structural layouts with only primary objects conditioned on text descriptions, top-down binary room masks, and spatial relation graphs, establishing a stable global macro-skeleton of large core furniture. Then CLG takes the generated structural layout as support geometric anchors to model the cross-scale long-range dependencies and synthesize dense secondary objects through a local conditional generation network with a carefully-designed learnable spatial-semantic modulation mechanism. By aligning each generation stage with the spatial and semantic regularities of different object groups, our method reduces the entanglement between global room planning and local support-aware placement. Experimental results on the challenging multi-source M3DLayout benchmark demonstrate that HetScene achieves state-of-the-art performance, enabling scalable generation of realistic, physically plausible, and high-density indoor scenes. Figure 1 : Given a text prompt, a relation graph, and a room footprint as input, HetScene generates a dense indoor layout in two stages. Structural Layout Generation captures the global functional organization of the room by synthesizing primary objects, while Contextual Layout Generation takes the generated primary layout as spatial context and support guidance, and places secondary objects around their corresponding primary objects. The resulting layout is finally instantiated into a complete indoor scene by retrieving 3D assets from an asset collection. † † footnotetext: MSC2020: Primary 00A05, Secondary 00A66. 1. Introduction Realistic 3D indoor layout generation is a research topic of growing importance at the intersection of computer graphics and embodied AI, serving as critical infrastructure for training and evaluating embodied agents in simulated physical environments. Early approaches typically formulate this task as a procedural or optimization problem driven by rule-based constraints, handcrafted heuristics, or scene priors [ 27 , 20 , 21 , 28 , 15 ] . Although such methods provide physical plausibility, their expressive capacity is inherently limited by manually designed heuristics. They often struggle to capture the complex semantic relationships, diverse spatial configurations, and long-tail object distributions in real-world scenes, leading to stylistically monotonous generation results. To overcome these limits, recent works have shifted toward data-driven 3D layout generation, where auto-regressive models or diffusion models are adopted to learn the object placement distributions directly from large-scale scene datasets [ 18 , 22 , 10 , 8 ] . These methods have significantly improved the diversity and realism of generated layouts. Nevertheless, most progress is achieved under simplified settings, where scenes are relatively sparse, small objects are filtered and object counts are carefully controlled. This strategy improves the tractability but also removes the challenging structures. When it comes to realistic indoor environments, layouts involve dense object arrangements and complex spatial relationships that must be satisfied jointly. In these circumstances, existing data-driven approaches often demonstrate limited capabilities in producing high-quality and scalable layouts. Beyond the data limitation, we further observe that the degradation may stem from the modeling mismatch between existing generative formulations and the heterogeneous composition of indoor scenes. Current generative pipelines typically adopt a homogeneous formulation, treating all objects as instances to be generated within the same modeling process, which neglects the heterogeneity that different objects play distinct roles in providing spatial and semantic information that shapes an indoor scene. Specifically, in a typical room, objects can be broadly divided into two groups that contribute to the layout in different ways. The first is primary objects , such as beds, sofas, tables, and cabinets. These objects usually occupy substantial floor area, are relatively independent of one another, and are mainly governed by global room-level constraints, including wall alignment, functional zones, accessibility, and walkable space. The second group is secondary objects , such as books, desk lamps, pillows, monitors, and decorations. These objects are typically smaller, more numerous, and strongly dependent on nearby primary objects through physical support, contact, and semantic co-occurrence. These two groups follow distinct statistical and geometric distributions: primary objects are sparse and globally constrained, whereas secondary objects are dense and locally conditioned. Mainstream diffusion-based layout models conflate these two regimes. DiffuScene [ 22 ] and MiDiffusion [ 8 ] represent all objects in a room as a unified, fixed-length object attributes and jointly denoise them within a shared representation space, forcing the network to simultaneously handle global room planning for primary objects and local support-aware placement for secondary objects. BuildingBlock [ 10 ] introduces a hierarchical modeling process at the pipeline level, but it still generates all objects in a unified representation, while fine-grained objects are adjusted through post-processing. Without explicit modeling of support relations and functional co-occurrence priors, the dense local dependencies introduced by secondary objects rapidly increase the generation complexity, making existing layout generation models struggle to scale to realistic, object-rich indoor scenes. Motivated by this observation, we reformulate indoor layout generation as a heterogeneous generation problem that explicitly aligns the generative process with the structural roles of different object groups and propose HetScene , a two-stage diffusion-based framework for dense indoor scene generation. In the first stage, Structural Layout Generation (SLG) establishes the global functional organization of the room by generating primary objects conditioned on text descriptions, room masks, and spatial relation graphs. In the second stage, Contextual Layout Generation (CLG) takes the generated primary layout as spatial context and support guidance, and synthesizes secondary objects around their corresponding primary objects. This decomposition transforms the original problem from joint generation over all objects into a combination of global layout planning and local support-conditioned object placement. By assigning each object group to a generation process that matches its spatial and semantic regularities, our framework allows each stage to model a better-conditioned sub-distribution: sparse, globally constrained primary layouts in SLG, and dense, locally conditioned secondary arrangements in CLG. In this way, our framework can improve the plausibility and scalability of object-rich indoor layout generation without imposing a fixed upper bound on the number of objects per room. Our contributions are summarized as follows: • We propose HetScene , a heterogeneity-aware layout generation framework that decomposes indoor scene synthesis into structural layout generation and context-conditioned layout generation, enabling global room organization and local support-aware placement to be modeled separately. The CLG stage can serve as a plug-and-play component compatible with arbitrary upstream coarse layouts. • We introduce a learnable spatial-semantic modulation mechanism that adaptively calibrates the relative contribution of continuous geometric attributes and discrete semantic embeddings during layout token construction, enabling stable joint training of primary and secondary objects in dense scenes. This calibration is empirically