FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flow

Zhifei Yang 1∗ , Guangyao Zhai 2∗ , Keyang Lu 1 , YuYang Yin 3 , Chao Zhang 4† , Zhen Xiao 1† , Jieyi Long 5 , Nassir Navab 2 , Yikai Wang 6 · 2026

Read FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flow by Zhifei Yang 1∗ , Guangyao Zhai 2∗ , Keyang Lu 1 , YuYang Yin 3 , Chao Zhang 4† , Zhen Xiao 1† , Jieyi Long 5 , Nassir Navab 2 , Yikai Wang 6 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19598.txt.

Introduction

Yang and co-authors present FlowScene, a model that generates indoor scenes with consistent style. Language-driven tools fetch objects from a database but lack fine control and style unity. FlowScene works from multimodal graphs that encode object relations. Three branches generate layouts, object shapes, and object textures together. A rectified flow core lets objects exchange information during generation. That coupling gives fine control over shapes, textures, and relations. Tests beat language- and graph-based baselines on realism, style consistency, and human preference.

Catalog record

CREATORZhifei Yang 1∗ , Guangyao Zhai 2∗ , Keyang Lu 1 , YuYang Yin 3 , Chao Zhang 4† , Zhen Xiao 1† , Jieyi Long 5 , Nassir Navab 2 , Yikai Wang 6
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69333
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.19598

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flow Zhifei Yang 1∗ , Guangyao Zhai 2∗ , Keyang Lu 1 , YuYang Yin 3 , Chao Zhang 4† , Zhen Xiao 1† , Jieyi Long 5 , Nassir Navab 2 , Yikai Wang 6 Abstract . Scene generation has extensive industrial applications, demanding both high realism and precise control over geometry and appearance. Language-driven retrieval methods compose plausible scenes from a large object database, but overlook object-level control and often fail to enforce scene-level style coherence. Graph-based formulations offer higher controllability over objects and inform holistic consistency by explicitly modeling relations, yet existing methods struggle to produce high-fidelity textured results, thereby limiting their practical utility. We present FlowScene, a tri-branch scene generative model conditioned on multimodal graphs that collaboratively generates scene layouts, object shapes, and object textures. At its core lies a tight-coupled rectified flow model that exchanges object information during generation, enabling collaborative reasoning across the graph. This enables fine-grained control of objects’ shapes, textures, and relations while enforcing scene-level style coherence across structure and appearance. Extensive experiments show that FlowScene outperforms both language-conditioned and graph-conditioned baselines in terms of generation realism, style consistency, and alignment with human preferences. Figure 1. Scene Generation from Diverse Input. The prospective system, powered by FlowScene , supports the generation of style-consistent 3D scenes from multi-source descriptions, including text input, GUI selections, and mixed information. Users can flexibly specify object categories and, if desired, provide their detailed RGB images in arbitrary views, along with their optional inter-object relationships (A). These descriptions are parsed into a multimodal graph by modern LLMs or VLMs as graph constructors (B). Based on this graph, FlowScene generates complete textured scenes, comprising both spatial scene layout and individual posed objects (C). ∗ Equal contribution. † Corresponding authors. 1. Introduction Scene generation from user prompts supports a wide spectrum of applications in manufacturing and interior design ( 72 ) , VR/AR content creation ( 3 ) , autonomous driving ( 52 ) , and robotics ( 28 ) . These settings demand high realism and precise control over geometry and appearance, allowing users to specify object categories, semantic and spatial relations, and desired individual appearances. The scene generator must follow these instructions while preserving scene-level style consistency across object structure and visual appearance. A prospective workflow is able to transfer flexible and diverse inputs into a high-quality scene (cf. Figure 1 A and C ). Training-free approaches ( 80 ; 59 ) that rely directly on large models fail to meet this goal. They typically retrieve well-designed meshes to compose scenes from coarse language commands, yet provide limited per-object control, overlook inter-object relations, and rarely maintain scene-level style consistency. This leads to scale, topology, and appearance mismatches in the final scenes. For more interactive workflows, scene-graph–based methods ( 69 ; 85 ; 84 ; 81 ) explicitly model objects and their relations, enabling strong per-object controllability, better handling of relational constraints, and improved structural consistency. However, these methods fail to generate textured scenes in an end-to-end manner, which results in low-fidelity generation and limits their utility in downstream tasks. Simultaneously achieving high fidelity and maintaining style consistency across objects under flexible control is non-trivial, especially when some objects lack visual or textual cues. In such cases, the model must aggregate scene-level context to guide the generation of their geometry and appearance. In this paper, we introduce FlowScene for compositional scene generation that maintains high fidelity and style consistency. As shown in Figure 1 B-C , FlowScene accepts a multimodal scene graph in which each node can fuse textual and visual information of the object, and employs three branches to generate scene layouts, object shapes, and object textures, respectively. At the core of each branch is Multimodal Graph Rectified Flow , which tightly couples exchanges of node information. Specifically, every node carries denoising states matched to each branch, including bounding boxes for the layout branch, voxelized latents for the shape branch, and structured latents for the texture branch. Throughout the denoising steps, nodes interact iteratively with each other along graph edges, ensuring progressively refined results and yielding fine-grained control over per-object appearance, inter-object spatial relations, and cross-object style consistency across structure and texture. Textured shapes are finally populated into the generated layout to produce the full scene. We train FlowScene on 3D-FRONT ( 16 ) with SG-FRONT ( 85 ) . Experimental performance shows that our results outperform language-driven synthesis ( 80 ; 59 ) and graph-conditioned generation ( 81 ) in realism, style consistency, and human preference. Moreover, FlowScene significantly accelerates the graph-conditioned generation process while enhancing both the quality of individual objects and the overall performance of holistic scene generation. For the long-horizon application scope, we apply FlowScene as a robust backend that initiates scene creation based on user-provided sentences, or interactive selections of objects and relationships, or both. Our contributions are summarized as follows: • We present FlowScene for generating high-fidelity 3D scenes from multimodal graphs, supporting fine-grained control in object-level appearance and scene-level style consistency across structure and texture. • We detail the core of FlowScene as Multimodal Graph Rectified Flow . It exchanges node information during sampling to satisfy both individual and holistic conditions, and achieves faster generation than the previous diffusion-based mechanism. • We show stronger performance than competitors in generation realism, style consistency, and human preference alignment. We provide a workflow of how FlowScene facilitates scene generation from diverse input sources. 2. Related Work Scene Graph and Applications Scene graphs provide a symbolic representation of a scene as a graph with object nodes and directed edges encoding inter-object relations. They can be constructed from multiple modalities, including text ( 87 ) , 2D images ( 54 ) , and 3D geometry ( 33 ) , and even 4D spatio-temporal data ( 77 ) , enabling rich spatial and temporal understanding. Early works established scene graphs for retrieval and reasoning ( 34 ) , and subsequent research has leveraged them across a wide range of downstream tasks, including visual retrieval ( 31 ; 13 ; 14 ; 66 ) , question answering ( 63 ) , controllable image synthesis ( 70 ) , video synthesis ( 7 ; 82 ) , 3D scene understanding ( 42 ) , and 3D scene synthesis ( 81 ) . Scene graphs also support embodied applications such as manipulation planning ( 83 ) and instruction-conditioned navigation ( 56 ; 45 ) . In this work, we adopt a multimodal graph formulation that integrates textual and visual information at the node level ( 81 ) . Rectified Flow and Applications Rectified flow and flow matching ( 41 ) have emerged as a strong alternative to diffusion-based generators ( 24 ) , leveraging straight-line supervision with deterministic ODE sampling to reduce training variance and enable few-step generation. At scale, rectified flow transformers achieve the best image quality with competitive speed and model scaling behavior ( 12 ) , and multi-rate designs extend these benefits to video by improving temporal coherence and long-horizon efficiency ( 29 ) . Efficient ODE solvers further amplify these gains ( 43 ) , while related fast-sampling paradigms provide complementary perspectives on one/few-step generation ( 58

Read the complete text