CasaGPT : Cuboid Arrangement and Scene Assembly for Interior Design

Weitao Feng, Hang Zhou, Jing Liao, Li Cheng, Wenbo Zhou · 2025

Read CasaGPT : Cuboid Arrangement and Scene Assembly for Interior Design by Weitao Feng, Hang Zhou, Jing Liao, Li Cheng, Wenbo Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19478.txt.

Introduction

Weitao Feng and co-authors present CasaGPT, a method to build indoor scenes, in a 2025 paper. Past tools place full objects from bounding boxes, which can cause clashes in the room. Their method breaks each object into simple cuboid blocks and learns to arrange those blocks one by one.

A step by step model builds scenes that stay physically plausible. A filter step in fine tuning throws out scenes where objects collide, which cuts clashes further. The team also cleaned a known scene data set of much of its noise. Tests on both the old and cleaned sets beat leading methods on realism. The work offers a compact path to scene design for interiors.

Catalog record

CREATORWeitao Feng, Hang Zhou, Jing Liao, Li Cheng, Wenbo Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19478

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CasaGPT : Cuboid Arrangement and Scene Assembly for Interior Design Weitao Feng, Hang Zhou, Jing Liao, Li Cheng, Wenbo Zhou Abstract We present a novel approach for indoor scene synthesis, which learns to arrange decomposed cuboid primitives to represent 3D objects within a scene. Unlike conventional methods that use bounding boxes to determine the placement and scale of 3D objects, our approach leverages cuboids as a straightforward yet highly effective alternative for modeling objects. This allows for compact scene generation while minimizing object intersections. Our approach, coined CasaGPT for Cuboid Arrangement and Scene Assembly, employs an autoregressive model to sequentially arrange cuboids, producing physically plausible scenes. By applying rejection sampling during the fine-tuning stage to filter out scenes with object collisions, our model further reduces intersections and enhances scene quality. Additionally, we introduce a refined dataset, 3DFRONT-NC, which eliminates significant noise presented in the original dataset, 3D-FRONT. Extensive experiments on the 3D-FRONT dataset as well as our dataset demonstrate that our approach consistently outperforms the state-of-the-art methods, enhancing the realism of generated scenes, and providing a promising direction for 3D scene synthesis. Code is available at https://github.com/CASAGPT/CASA-GPT 1 Introduction Creating a comprehensive model capable of generating sophisticated and realistic furnished interior spaces for virtual walk-throughs is a challenging task in computer graphics, with wide-range applications in game development, VR/AR, and interior design. Scene synthesis also enables automatic environment creation for products displayed in retail, films, and games Zhao et al. 2021 , while providing valuable data for training AI models in 3D scene understanding Deitke et al. 2022 ; Chang et al. 2017 ; Cho et al. 2025 . Traditional indoor scene synthesis approaches framed the problem as an optimization task with predefined constraints, often guided by design principles and spatial guidelines Merrell et al. 2011 ; Fisher et al. 2012 rooted in aesthetic and ergonomic criteria Fisher et al. 2011 ; Yu et al. 2015 ; Leimer et al. 2022 . These methods relied on rules tailored for modeling object relationships (e.g., table-chair pairs) and handcrafted constraints on human-object interactions (e.g., affordance maps) to guide layout generation Fisher et al. 2015 ; Fu et al. 2017 ; Jiang et al. 2012 . However, these approaches were computationally expensive and struggled to scale for more complex scenes. Recent approaches addressed these limitations using data-driven methods that leverage deep generative models for interior design. For instance, autoregressive models improved scene realism by sequentially predicting object properties Wang et al. 2021 ; Paschalidou et al. 2021 , while diffusion-based models enabled high-quality scene synthesis with diverse range of outputs Tang et al. 2024 ; Zhai et al. 2024 . Despite their impressive capabilities, these models often produce physically implausible scenes with significant object collisions. This raises a critical question: What causes object collisions during scene generation? We aim to address this issue from following two perspectives: ( i ) Training data often contain significant noises with intersecting objects (e.g. Figure 4 ). We observe that most previous methods represent mesh objects as bounding boxes, which have inherent limitations, as box intersections often do not align with actual mesh intersections, as shown in . To address the challenges of modeling spatial relationships among meshes, we treat each mesh as an assembly of cuboids. These cuboids can then be effectively modeled using autoregressive approaches for scene generation. ( ii ) Given the probabilistic nature of generative models Murphy 2012 , object collisions are inevitable due to the inherent uncertainty in the generation process. However, the collision rate can be significantly reduced by incorporating rejection sampling Liu et al. 2024 ; Yuan et al. 2023 ; Khaki et al. 2024 into scene synthesis, to reject scenes with bounding box intersections during fine-tuning. Built upon this analysis, we present a simple, effective, and compact autoregressive model, CasaGPT , capable of arranging scene objects without intersections. CasaGPT utilizes the cuboid primitives, decomposed from meshes, as input tokens for scene modeling. With this approach, we can achieve a 90.6\% non-occlusion rate for bedrooms. Our contributions are summarized as follows: Cuboid-Based Scene Representation. We model shapes using cuboid primitives for interior scene synthesis, ensuring compactness and effectively avoiding object collisions. Advanced Autoregressive Modeling. CasaGPT employs a Llama-3 based autoregressive model for cuboid sequence modeling and integrates rejection sampling during fine-tuning to enable more refined scene generation. New Dataset Curation. We introduce 3DFRONT-NC, a refined dataset with minimized object intersections, where objects are represented by cuboid assemblies. Comprehensive Evaluation. Extensive experiments demonstrate that CasaGPT significantly reduces object intersections and improves generation quality across various scenarios. 2 Related work Heuristic scene synthesis. A great many classical methods in computer graphics employ heuristics and predefined rules to restrict object positioning Xu et al. 2002 ; Yu et al. 2011 ; Weiss et al. 2018 . Make-it-Home Yu et al. 2011 investigated human factors, such as accessibility, visibility, and pathway constraints for the evaluation of synthetic scenes. Works have also focused on scene generation and evolution navigated by human activities Fisher et al. 2015 ; Ma et al. 2016 . An alternative approach is procedural modeling Qi et al. 2018 ; Purkait et al. 2020 , which recursively applies a set of functions for scene synthesis. SG-VAE Purkait et al. 2020 learned co-occurrences, shapes and poses through a grammar-based auto-encoder Kusner et al. 2017 . In contrast, our model implicitly captures inter-object relationships without the need for hand-crafted constraints. Figure 1 : Overview of the CasaGPT framework for indoor scene generation. (a) Model Pre-training : Objects in the scene are encoded using distinct tokens representing entities and cuboids. An autoregressive training process in the Transformer Decoder enables the generation of complex layouts. (b) Rejection Sampling : Iterative refinement is applied through cuboid collision inspection to reject unsuitable generation results, followed by model fine-tuning, resulting in high-quality, realistic 3D layouts. Graph modeling for scene synthesis. Representing indoor scenes as graphs has been widely explored in Fisher et al. 2012 ; Wang et al. 2019 ; Li et al. 2019 ; Zhou et al. 2019b ; Gao et al. 2023 ; Wei et al. 2023 ; Tang et al. 2024 ; Zhai et al. 2024 . Fisher et al. Fisher et al. 2012 introduced a probabilistic model based on Bayesian networks and Gaussian mixtures that can be trained with few-shot learning. GRAINS Li et al. 2019 represented scenes as parsing trees with the location of each node annotated by its relative position to the parent node. SceneHGN Gao et al. 2023 extended this approach and captured the full hierarchy from the room level to object and object part levels. SceneGraphNet Zhou et al. 2019b employed graph generative networks to facilitate message passing, enabling the learning of node representations and their interactions. CommonScenes Zhai et al. 2024 and EchoScene Zhai et al. 2025 both introduced a dual-decoder for graph generative models, with separate decoders dedicated to layout and shape generation. LEGO-Net Wei et al. 2023 and DiffuScene Tang et al. 2024 employed denoising diffusion models by representing scenes as fully connected graphs and DeBaRA Maillard et al. 2024 extended it to score based model. InstructScene Lin and Mu 2024 incorporated pairwise spatial relations (e.g., left of, above) into graph construction for fine-grained scene editing. PhyScene Yang

Read the complete text