ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignment
Chong Xia, Shengjun Zhang, Fangfu Liu, Chang Liu · 2025
Read ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignment by Chong Xia, Shengjun Zhang, Fangfu Liu, Chang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19058.txt.
Introduction
Xia leads a team presenting ScenePainter, a system for generating long, consistent 3D scene sequences, in a 2025 paper. Endless scene generation suits long videos and scene reconstruction. Standard outpainting drifts in meaning as views accumulate.
ScenePainter builds a layered graph of scene concepts and their relations. That graph steers the outpainter to stay faithful to the current scene's content. The graph can also be refined on the fly to add variety. Tests showed the method beating the semantic drift problem that plagues rivals. View sequences stayed more consistent and immersive over long runs. The authors frame relation alignment as the fix for drift. A project page shows examples.
Catalog record
| CREATOR | Chong Xia, Shengjun Zhang, Fangfu Liu, Chang Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19058
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignment Chong Xia, Shengjun Zhang, Fangfu Liu, Chang Liu Abstract Perpetual 3D scene generation aims to produce long-range and coherent 3D view sequences, which is applicable for long-term video synthesis and 3D scene reconstruction. Existing methods follow a “navigate-and-imagine” fashion and rely on outpainting for successive view expansion. However, the generated view sequences suffer from semantic drift issue derived from the accumulated deviation of the outpainting module. To tackle this challenge, we propose ScenePainter, a new framework for semantically consistent 3D scene generation, which aligns the outpainter’s scene-specific prior with the comprehension of the current scene. To be specific, we introduce a hierarchical graph structure dubbed SceneConceptGraph to construct relations among multi-level scene concepts, which directs the outpainter for consistent novel views and can be dynamically refined to enhance diversity. Extensive experiments demonstrate that our framework overcomes the semantic drift issue and generates more consistent and immersive 3D view sequences. Project Page: https://xiac20.github.io/ScenePainter/ . † † † Corresponding author. 1 Introduction With the rapid development of diffusion models, 3D generation has become one of the most significant problems in 3D computer vision. One main branch perpetual 3D scene generation has garnered more attention from academia and industry for their potential in large 3D scene construction and long video synthesis. Given an initial single image or a scene description, perpetual 3D scene generation aims to generate a series of 3D scene views, which are consistent in geometry and semantic relations. To achieve this, previous works mainly follow a ’navigate and imagine’ paradigm, which can be decomposed into the iterative processes of unprojecting, rendering, and outpainting. The geometry consistency problem has been well solved by previous works due to the improved monocular depth estimation and effective 3D scene representations like point cloud, mesh or 3D gaussian splatting [ 17 ] . However, the semantic consistency problem has not received enough attention, and causes serious semantic drift issue derived from the accumulated deviation and artifacts of the native outpainting process. One of previous state-of-the-art models WonderJourney [ 36 ] frequently encounters semantic drift issue, shifting from the arid desert to the vibrant lake or shifting from lush green scenes to snow-covered landscapes. Although this work is dedicated to generating diverse views, the scene inconsistency problem remains particularly pronounced and affects the scene quality. In addition, the semantic drift issue is bypassed in earlier works like InfiniteNature-Zero [ 20 ] and SceneScape [ 10 ] , as they maintain subtle camera movements between adjacent frames for smooth geometric transformation, which hinders the generation of novel objects and leads to monotonous scenes. Therefore, generating semantically consistent and content-rich scene views is a key challenge in 3D scene generation as shown in Figure . Towards this goal, we propose ScenePainter, a two-stage framework for semantically consistent yet visually diverse 3D scene generation illustrated in Figure 2 . In the first stage of concept relation construction, we propose a scene-level customization method to achieve a thorough comprehension of the current scene. Unlike previous single image or multi-concept customization methods, scenes contain richer concepts and more complicated relations among them, such as the relative spatial position of objects, semantic distribution, spatial layout and overall style, which makes achieving satisfactory customization results particularly challenging. To solve this problem, we first extract multilevel scene concepts rather than simply multiple objects, and then leverage a hierarchical graph structure dubbed SceneConceptGraph to further construct the relations among concepts. For each concept-relation pair in the SceneConceptGraph, we take it as dedicated textual embeddings for text-to-image models to restore the original image region referenced by the relation. In this way, we obtain scene-specific textual embeddings of each concept-relation pair and optimized text-to-image model, which jointly direct the subsequent outpainting model with scene-specific prior transmission. In the second stage of concept relation refinement, we follow the mainstream 3D generation framework and align the native outpainting model with extracted scene-specific prior to achieve semantically consistency and mitigate generation deivation. To be specific, we initialize the outpainter with the aforementioned optimized text-to-image model and guide the outpainting process with updated concept-relation pair. Further, generating nearly identical scenes would lead to repetition and monotony, thus we strive to enhance visual diversity while ensuring semantic consistency. During the outpainting process, we can dynamically add new objects, change existing objects, or smoothly transition to other scenes with test-time refinement of the SceneConceptGraph. In this way, users can easily enrich and expand the current scene while enabling novel creation, thereby achieving both consistency and diversity simultaneously. Our main contributions are as follows: • We design a scene-level customization method, which constructs the concepts and relations of the scene and generates consistent scene views. • We propose a new 3D scene generation framework ScenePainter, which aligns the outpainting model with scene-specific prior for consistent and diverse scene expansion. • Extensive experiments demonstrate that our framework produces more consistent and vivid 3D view sequences in comparison to previous state-of-the-art works. 2 Related Work Figure 2 : Overall framework of our approach ScenePainter . We propose a two-stage framework that constructs and refines scene concept relations with the graph structure SceneConceptGraph, and aligns the outpainting model with the scene-specific prior during the ongoing painting process. We use colored dots and regions to represent scene concept nodes and their masks, and black and red lines in SceneConceptGraph to denote the initial and newly added relation edges. Here, we simplify the update process in the second stage, which is similar to the one in the first stage. 3D Scene Generation. Due to the recent success of image diffusion models [ 13 , 24 , 22 ] , 3D scene generation has seen rapid developments. Existing methods can be mainly divided into two branches. One branch of methods [ 29 , 37 , 39 , 38 , 32 ] employ 2D panorama to represent panoramic environments and lift it to 3D space. However, limited by the representative capacity of 2D panoramas, these methods often result in blurry renderings, ambiguity and gaps in 3D scene. Moreover, they fail to generate arbitrary 3D scene following specific camera trajectory or interactive user instructions, which limits their applications. The other branch of methods [ 16 , 7 , 5 ] seeks to create perpetual scenes by leveraging a “navigate-and-imagine” paradigm, which renders the partial image, outpaints for a complete next view and repeats the process. The foundational works, Infinite Images [ 16 ] , Infinite Nature [ 21 ] and InfiniteNature-Zero [ 20 ] , first propose the autoregressive pipeline. SceneScape [ 10 ] further exploits the generative power and incrementally constructs a single cave-like environment. A recent development, WonderJourney [ 36 ] , focuses on creating diverse view sequences combining off-the-shelf models. While these approaches explore scene generation, they either generate diverse scene with obvious semantic drift issue or generate scenes with limited content and viewpoints. In contrast, our approach generates scene-consistent and content-rich view sequences, achieving the balance between consistency and diversity. Customized Generation. Customized image generation has attracted increasing attention due to its ability to create consistent images with user preferences. Two fundamental methods in text-to-image model customization are Textual Inversion (TI) [ 11 ] and DreamBooth (DB)