Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View
Zitong Zhang Suranjan Gautam Rui Yu University of Louisville {zitong.zhang, suranjan.gautam, rui.yu}@louisville.edu https://top2pano.github.io/ · 2025
Read Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View by Zitong Zhang Suranjan Gautam Rui Yu University of Louisville {zitong.zhang, suranjan.gautam, rui.yu}@louisville.edu https://top2pano.github.io/ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21371.txt.
Introduction
Zitong Zhang, Suranjan Gautam, and Rui Yu generate room views in a 2025 computer vision paper. Turning a flat top-down floor view into a full surround panorama would serve virtual tours, design, and robotics, but the top view hides height and depth. Their model, Top2Pano, rebuilds the missing dimension in stages.
It first estimates which parts of the room volume are filled, then renders rough color and depth panoramas from that volume. A diffusion stage, guided by controls, polishes the result toward realism. On two datasets it beat rivals at geometry, occlusion, and layout fidelity. It even handled schematic floorplans well. The authors present it as a bridge from flat plans to immersive interiors.
Catalog record
| CREATOR | Zitong Zhang Suranjan Gautam Rui Yu University of Louisville {zitong.zhang, suranjan.gautam, rui.yu}@louisville.edu https://top2pano.github.io/ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21371
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View Zitong Zhang Suranjan Gautam Rui Yu University of Louisville {zitong.zhang, suranjan.gautam, rui.yu}@louisville.edu https://top2pano.github.io/ Abstract Generating immersive 360° indoor panoramas from 2D top-down views has applications in virtual reality, interior design, real estate, and robotics. This task is challenging due to the lack of explicit 3D structure and the need for geometric consistency and photorealism. We propose Top2Pano , an end-to-end model for synthesizing realistic indoor panoramas from top-down views. Our method estimates volumetric occupancy to infer 3D structures, then uses volumetric rendering to generate coarse color and depth panoramas. These guide a diffusion-based refinement stage using ControlNet, enhancing realism and structural fidelity. Evaluations on two datasets show Top2Pano outperforms baselines, effectively reconstructing geometry, occlusions, and spatial arrangements. It also generalizes well, producing high-quality panoramas from schematic floorplans. Our results highlight Top2Pano’s potential in bridging top-down views with immersive indoor synthesis. Figure 1 : Top: We present Top2Pano , a method for synthesizing high-quality indoor panoramas from a top-down view. Given a camera position, Top2Pano generates panoramas that are both visually compelling and geometrically accurate. Bottom: Our model demonstrates strong generalization capabilities. When provided with schematic floor plans as input, Top2Pano produces photorealistic and structurally coherent panoramas. Additionally, our approach can be easily adapted for stylized synthesis, enabling diverse design variations. Note: The original dataset (Matterport3D [ 3 ] ) contains blurry regions near the upper and lower edges of the panoramic image. Figure 2 : Overview of the proposed Top2Pano pipeline. The pipeline begins by segmenting the top-down view using SAM [ 19 ] . Both the segmented top-down image and the original top-down view are then processed by the OccRecon module to estimate the scene’s 3D volumetric occupancy. Next, given the camera position, the system employs volumetric rendering to generate coarse depth and color panoramas. These coarse images are subsequently refined by the PanoGen module to produce the final photorealistic panorama. The PanoGen module also supports stylized panorama generation based on textual or visual conditions. 1 Introduction Understanding and synthesizing immersive indoor scenes from minimal structural information is a fundamental challenge in computer vision and graphics [ 20 , 44 , 40 , 16 , 21 , 32 ] . The ability to generate realistic indoor panorama images from a 2D top-down view holds immense potential for a wide range of applications, including virtual reality (VR) [ 23 ] , interior design [ 27 ] , real estate visualization [ 15 ] , and robotics [ 11 ] . For instance, real estate platforms can leverage this technology to offer potential buyers photorealistic virtual walkthroughs generated directly from architectural floorplans, enhancing the property viewing experience. Similarly, VR applications can benefit from automatically synthesized environments that create more engaging and immersive user experiences. Additionally, robots operating in indoor environments can utilize synthesized panoramas to improve their spatial understanding and navigation capabilities, enabling more efficient and accurate movement in complex spaces. Despite its broad applicability, the task of generating high-quality indoor panoramas from top-down views remains surprisingly underexplored in the literature. Recent advancements in large multimodal models have enabled the synthesis of panoramas directly from text input [ 10 , 41 , 39 ] ; however, these approaches often overlook critical geometric and textural constraints. Other studies have focused on generating 3D models from semantic layouts [ 2 , 38 , 4 , 9 , 30 , 8 ] ; however, these methods are often limited by the quality of the resulting 3D meshes, making them unsuitable for rendering high-quality panoramas. Furthermore, semantic information is often unavailable in top-down views or floorplans, posing an additional challenge for existing approaches. Addressing this gap requires overcoming several significant technical challenges. First, a 2D top-down view provides only limited visual cues about the actual appearance and layout of the scene, making it difficult to infer occluded structures and fine texture details. Second, generating geometrically consistent indoor scenes demands accurate reasoning about 3D spatial occupancy from a 2D input, which is inherently ambiguous. Third, achieving photorealism while maintaining structural coherence necessitates a synthesis approach that effectively balances fidelity and realism, ensuring that the generated scenes are both visually appealing and functionally accurate. To tackle these challenges, we introduce Top2Pano , a novel framework for generating photorealistic indoor panorama images from 2D top-down views. Our approach consists of three main stages. First, we learn the volumetric occupancy of the indoor scene, enabling the model to infer plausible spatial structures and layout configurations. Next, we employ volumetric rendering to generate coarse depth and colored panorama images, providing an initial estimate of the scene’s appearance and geometry. Finally, we refine the synthesized panoramas using a diffusion-based model [ 42 ] conditioned on the coarse representations, enhancing both realism and structural consistency. By incorporating learned occupancy priors and diffusion-based refinement, our model effectively bridges the gap between schematic top-down views and immersive indoor panoramas, producing results that are both visually compelling and geometrically accurate. We evaluate Top2Pano on two indoor datasets and demonstrate its effectiveness compared to baseline methods. Our model not only generates higher-quality images with improved geometric consistency but also exhibits strong generalization capabilities. Even when provided with schematic floorplans as input, Top2Pano can produce photorealistic and structurally coherent panoramas. Moreover, we show that our method can be easily adapted for stylized synthesis, allowing for diverse design variations and enabling users to explore different interior aesthetics with ease. Our key contributions are as follows: • We introduce Top2Pano, a novel framework for generating indoor panoramas from 2D top-down views, integrating volumetric occupancy learning, coarse synthesis, and diffusion-based refinement to achieve high-quality results. • We conduct extensive experiments on two indoor datasets, demonstrating that our model surpasses baseline methods in both image quality and structural consistency, setting a new benchmark for this task. • We show that Top2Pano generalizes well to schematic floorplans, producing high-quality, geometry-consistent panoramas. Furthermore, our approach supports stylish synthesis, enabling the generation of panoramas with diverse interior design aesthetics, making it a versatile tool for various applications. 2 Related Work 2.1 Panorama Generation Traditionally, panoramas were generated using image stitching and feature matching methods. With the recent advancements in generative machine learning, text-driven panorama generation techniques have gained popularity. These methods have utilized GANs, VAEs or a combination of GANs and VAEs [ 5 ] and more recently, diffusion models [ 10 , 41 , 39 ] to synthesize panoramic images from textual descriptions. Another popular field of research is panorama synthesis from narrow-FoV images using image out-painting. Some methods rely solely on narrow-FOV images [ 1 ] , while other incorporate textual descriptions alongside the images [ 6 , 34 , 17 ] . Cross-view panorama generation is another well-explored area, particularly challenging due to large shifts in camera perspective. Most techniques in this domain have focused on generating ground-view panoramas from aerial images. Some approaches directly use top-down images as input [ 35 ] , while others [ 31 , 22 , 28 , 37 ] extract geometric and segmentation information from top-down images to enhance quality. To the best of our knowledge, there is no prior work that explores the generation of indoor panoramic images from floor plans or top-down views of