Function2Scene : 3D Indoor Scene Layout from Functional Specifications Journal: TOG

Ruiqi Wang, Qimin Chen, Daniel Ritchie, Angel X. Chang, Manolis Savva, Kai Wang, Hao Zhang · 2026

Read Function2Scene : 3D Indoor Scene Layout from Functional Specifications Journal: TOG by Ruiqi Wang, Qimin Chen, Daniel Ritchie, Angel X. Chang, Manolis Savva, Kai Wang, Hao Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30819.txt.

Introduction

Wang and colleagues present Function2Scene, making 3D layouts from use-based briefs. Most methods make rooms from object-centric prompts. Yet layouts are judged by how well they support users. Given a brief, the system parses profiles and tasks, then derives constraints from 17 criteria. They span spatial, comfort, task, and setting factors. Rather than relying on a language model to produce a scene, Function2Scene iterates evaluation and refinement. It combines geometric measurements, contextual reasoning, and assessment. Experiments on 30 cases show Function2Scene produces layouts that better satisfy requirements.

Catalog record

CREATORRuiqi Wang, Qimin Chen, Daniel Ritchie, Angel X. Chang, Manolis Savva, Kai Wang, Hao Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95231
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30819

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Function2Scene : 3D Indoor Scene Layout from Functional Specifications Journal: TOG Ruiqi Wang, Qimin Chen, Daniel Ritchie, Angel X. Chang, Manolis Savva, Kai Wang, Hao Zhang Abstract . Most text-driven 3D indoor scene synthesis methods generate rooms from object-centric prompts, asking what furniture should be placed rather than how the space is used. Yet in real interior design, a layout is judged by how well it supports its occupants, e.g., their activities and physical needs. We introduce Function2Scene , a framework for generating 3D indoor layouts from functional specifications, i.e., natural-language design briefs describing who will use a room and what they need to do there. Given such a specification, our system parses occupant personas and activities, derives a customized set of functional design constraints from a taxonomy of 17 criteria spanning spatial, ergonomic, activity, and environmental considerations, and uses these constraints to guide layout generation. Rather than relying on an LLM to directly produce a final scene, Function2Scene performs iterative evaluation and refinement through a tool-augmented check-and-repair loop, combining geometric measurements, LLM-based contextual reasoning, and VLM-based visual assessment. Experiments on 30 professionally written interior-design cases show that Function2Scene produces layouts that better satisfy functional requirements than recent LLM-based scene synthesis baselines, with our results preferred in 94.3% of pairwise comparisons. Our work reframes text-driven indoor scene synthesis from placing plausible objects to designing spaces that support human use. Figure 1. We present Function2Scene , a framework for generating 3D indoor layouts from functional specifications. Given a detailed functional specification, our method decompose them into functional design constraints, which are then used to iteratively evaluate and refine a generated scene. Please refer to the supplementary material for the full input prompt and more detailed visualizations. This is the teaser figure for the article. 1. Introduction A furnished room is not only a collection of objects, but a proposal for how a space should be used. Furniture layout determines how people circulate, where they sit and look, what they can reach, and which activities can happen. A room can be visually and semantically plausible, yet still be a poor design: a desk facing direct window glare, a sofa blocking the path to the door, a wardrobe unreachable by a senior who uses it, or a child’s play area hidden from their caregiver. Function is not a secondary attribute — it is one of the primary reasons behind any layout decision. The computer graphics community has long recognized and studied this. Early scene generation works encoded design guidelines, such as clearance, grouping, alignment, accessibility, as explicit cost functions ( Merrell et al. 2011 ; Yu et al. 2011 ) , but authoring such constraints required significant expertise and effort, making them hard to adapt to different scenarios. To address this limitation, the field pivoted to data-driven approaches, starting with pairwise spatial priors ( Yu et al. 2011 ; Fisher et al. 2012 ) , and advancing through the deep learning era with increasingly expressive learned priors with convolutional neural networks ( Wang et al. 2018 ) , autoregressive transformers ( Paschalidou et al. 2021 ) , and denoising diffusion ( Tang et al. 2024 ; Zhai et al. 2023 ) . These work capture increasingly rich statistical patterns, but in doing so, make functional design knowledge more and more implicit and uninterpretable. Entering the foundation model era, LLM-based systems ( Feng et al. 2023 ; Yang et al. 2024c ; Çelen et al. 2024 ; Feng et al. 2025 ; Sun et al. 2025a ) enabled flexible text conditioned scene synthesis. More recently, agentic pipelines also enable iterative scene updates to further improve scene quality ( He et al. 2026 ; Luo et al. 2026 ; Xia et al. 2026 ; Zhao et al. 2026 ) . Leveraging foundational priors, these systems support more open-ended scene generation. However, they largely inherit the learning era’s “implicit" approach: an LLM directly generates objects, transforms relations, and even in agentic setups, the result is mostly checked only for visual quality and physical plausibility. Consistent with their goals, most LLM-based methods consume detailed object-centric prompts, for example, “a bedroom with a queen bed, two nightstands, and a dresser.” They are not targeting more “functionality"-oriented prompts, for example, “a bedroom for a couple where one partner reads late while the other sleeps early.” Yet, the latter describes a far more common starting point in real design practices ( Kilmer and Kilmer 2024 ; Panero 1962 ) . The irony is that LLMs are well suited to the two tasks that limited classical rule-based layout generation in the first place: parsing open-ended functional descriptions, and optimizing functional criteria that are cost prohibitive to manually specify. We study 3D indoor scene layout from functional specifications : natural-language design briefs that describe who will use a space, what they will do in it, and what constraints their needs impose. Such briefs are closer to an interior design program than to a short text-to-scene command. For the scope of this work, we use professionally written room descriptions adapted from sources such as Architectural Digest . This problem formulation introduces unique challenges, as functional specifications are inherently high-level: instead of directly specifying objects and layout, they impose diverse and heterogeneous constraints over the indoor space: spatial constraints, ergonomic rules, activity patterns, environmental contexts, etc. Consequently, LLMs tasked to directly generate scenes from such functional specification not only struggle with producing scenes that meet the functional demands, but also frequently fail to produce meaningful scenes, without the availability of more explicitly worded prompts. To address these challenges, we introduce Function2Scene , a framework that empowers LLMs for such functional scenarios. Given a functional specification, we begin by analyzing the “personas," i.e., who the occupants are and what specific needs they have, and the “activities," i.e., what the occupants do in the space. We then generate a detailed scene description, as well as a set of design guidelines drawn from a taxonomy of 17 criteria organized into four categories, Spatial, Ergonomic, Activity, and Environmental, grounded in interior-design literature ( Kilmer and Kilmer 2024 ; Panero 1962 ) , that conforms to the personas and their activities. This revisits the classical idea of codifying design rules for layout generation ( Merrell et al. 2011 ; Yu et al. 2011 ; Leimer et al. 2022 ) , but makes the selected rules customized to the specific functional specifications, a customization that is only possible thanks to the foundational knowledge of LLMs. Finally, we generate an initial layout and iteratively refine it through a check-and-repair loop to make the layout conform to the parsed design guidelines. Our functionality-aware pipeline generates diverse scenes from real-world functional specifications, with results preferred over all baselines and ablations in 94.3% of pairwise comparisons in a crowd-sourced two-alternative forced choice (2AFC) perceptual study. In summary, our contributions are: • A functionality-first framing for 3D indoor layout generation, shifting the input from object-centric prompts to functional specifications, and exposing failure modes not addressed by existing scene synthesis methods. • A design constraint taxonomy (Spatial, Ergonomic, Activity, Environmental) rooted in interior-design literature, together with an LLM-driven method for automatically customizing constraints to specific occupant personas and activities. • An iterative layout generation framework that

Read the complete text