A d a S F o r m e r : Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments
Xuzhi Wang, Xinran Wu, Song Wang, Lingdong Kong, Ziping Zhao, [1ex] Tianjin Normal University · 2026
Read A d a S F o r m e r : Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments by Xuzhi Wang, Xinran Wu, Song Wang, Lingdong Kong, Ziping Zhao, [1ex] Tianjin Normal University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25494.txt.
Introduction
Wang and co-authors fill in full 3D room scenes from one indoor photo with AdaSFormer. Indoor completion is harder than outdoor work: layouts tangle and objects hide each other. Transformers see the whole room at once but eat memory and blur fine detail. Their serialized design learns shifts that resize its field of view per spot. A center-based position code and a blend layer join map and photo traits cleanly. On NYUv2 and Occ-ScanNet it sets the best scores yet.
Catalog record
| CREATOR | Xuzhi Wang, Xinran Wu, Song Wang, Lingdong Kong, Ziping Zhao, [1ex] Tianjin Normal University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36154 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25494
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A d a S F o r m e r : Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments Xuzhi Wang, Xinran Wu, Song Wang, Lingdong Kong, Ziping Zhao, [1ex] Tianjin Normal University Abstract Indoor monocular semantic scene completion (MSSC) is notably more challenging than its outdoor counterpart due to complex spatial layouts and severe occlusions. While transformers are well suited for modeling global dependencies, their high memory cost and difficulty in reconstructing fine-grained details have limited their use in indoor MSSC. To address these limitations, we introduce A d a S F o r m e r , a serialized transformer framework tailored for indoor MSSC. Our model features three key designs: (1) an Adaptive Serialized Transformer with learnable shifts that dynamically adjust receptive fields; (2) a Center-Relative Positional Encoding that captures spatial information richness; and (3) a Convolution-Modulated Layer Normalization that bridges heterogeneous representations between convolutional and transformer features. Extensive experiments on NYUv2 and Occ-ScanNet demonstrate that ASFormer achieves state-of-the-art performance. The code is publicly available at: https://github.com/alanWXZ/AdaSFormer . Figure 1 : We introduce an Adaptive Serialized Transformer ( A d a S F o r m e r ) to obtain a global receptive field for indoor 3D scene understanding, enabling the model to handle complex spatial layouts and severe occlusions. (1) Existing indoor approaches rely on convolution-based designs due to the high memory cost of Transformers, which limits their global modeling capacity. (2) Existing serialization-based methods assign a fixed receptive field to each patch. In contrast, our method employs a learnable shift mechanism that adaptively adjusts the receptive fields and coordinate features across layers, achieving more flexible and effective spatial representation. It is worth noting that we employ bird’s-eye view (BEV) representations to simplify the 3D voxels, enabling clearer and more intuitive visualization. * * footnotetext: Corresponding authors. 1 Introduction Monocular semantic scene completion (MSSC) has recently gained traction in the context of autonomous driving 4 ; 76 ; 101 ; 3 ; 82 , as it enables holistic 3D understanding of complex outdoor environments from a single image 40 ; 68 . In contrast, indoor MSSC remains underexplored despite its fundamental importance to indoor scene perception, supporting applications in robot navigation, 3D reconstruction, and spatial understanding 31 ; 5 ; 29 ; 30 ; 84 ; 79 ; 16 ; 80 ; 83 . Indoor scenes differ substantially from outdoor settings 28 ; 46 ; 41 ; 42 ; 27 ; 81 ; 86 . Rather than featuring regular road layouts and open views, they contain intricate and multi-level spatial structures, including overlapping ceilings, walls, and furniture, with frequent occlusions and high object density 6 ; 37 ; 74 . This complexity demands not only accurate local geometry but also strong global contextual reasoning to infer the geometry and semantics of occluded regions 75 . Most existing approaches heavily rely on convolutional architectures 75 ; 90 ; 91 ; 64 . However, their inherently limited receptive fields prevent them from modeling long-range dependencies effectively, while enlarging kernels in 3D incurs prohibitive cubic computational cost 14 ; 10 . Early convolutional layers propagate information solely within local neighborhoods, while deeper layers operate at reduced resolutions, leading to spatial information loss and degraded completion quality 52 ; 17 ; 93 ; 39 . Modeling long-range dependencies is therefore essential, making transformer architectures a natural choice 66 ; 50 ; 20 . Yet, applying transformers directly to dense 3D volumes remains computationally expensive and memory-intensive 53 ; 22 ; 38 ; 40 ; 77 , especially for high-resolution indoor scenes 63 ; 91 . To address these challenges, we design A d a S F o r m e r , a hybrid framework that unifies convolutional and transformer modules, each serving complementary roles. The transformer operates on voxels containing valid features to capture global context, while the convolution focuses on local feature propagation and refinement. Our framework introduces three core designs: (1) Adaptive Serialized Attention (ASA), which employs learnable shifts to dynamically adjust receptive fields and coordinate features across layers; (2) Center-Relative Positional Encoding (CRPE) , which encodes spatial information richness relative to the scene center; and (3) Convolution-Modulated Layer Normalization (CMLN), which harmonizes feature statistics between convolutional and transformer representations. As illustrated in Fig. 2 , given a single RGB image, a 2D encoder first extracts features and estimates depth, which are projected into 3D space via surface projection 45 . Within the 3D encoder, alternating transformer and convolutional modules jointly capture global context and complete 3D geometry, followed by a lightweight decoder that integrates multi-scale features to produce final semantic scene completion (SSC) results. Our main contributions are summarized as follows: • We propose A d a S F o r m e r to capture long-range dependencies while maintaining efficiency through complementary feature propagation, substantially reducing both memory footprint and computational overhead. • We introduce three novel components, 1 Adaptive Serialized Attention , 2 Center-Relative Positional Encoding , and 3 Convolution-Modulated Layer Normalization , which collectively enhance receptive-field adaptability, spatial reasoning, and cross-module feature alignment. • Extensive experiments on the NYUv2 and OccScanNet datasets demonstrate that our approach achieves state-of-the-art performance against popular MSSC methods. 2 Related Work Monocular Semantic Scene Completion (MSSC). Scene completion tasks predicts both voxel occupancy and semantic labels, providing holistic 3D scene understanding 36 ; 73 ; 74 ; 70 ; 69 ; 42 . The pioneering SSCNet 99 introduced indoor SSC using depth maps, later extended to RGB-D inputs 73 ; 33 ; 45 ; 34 ; 8 and outdoor perception 88 ; 78 ; 58 ; 49 ; 48 ; 85 ; 102 . Recent monocular SSC approaches 32 ; 94 ; 26 ; 98 ; 97 ; 62 ; 35 ; 101 ; 40 ; 95 ; 71 ; 72 further advance the task by relying solely on RGB images. For indoor scenarios, where lightweight deployment is critical, several representative works have emerged: MonoScene 4 bridges 2D-3D features via Line-of-Sight Projection; NDC-Scene 90 introduces normalized device coordinates to reduce depth ambiguity; ISO 91 enhances voxel learning with dual projection; and MonoMRN 75 adopts a masked recurrent refinement design. Most indoor MSSC methods are CNN-based, achieving efficiency but limited global reasoning. In contrast, our approach employs an adaptive serialized transformer to enlarge receptive fields while maintaining low computational cost. Single-View 3D Reconstruction. Recovering 3D geometry from a single RGB image has long been studied for both objects and scenes 47 ; 25 . Early works reconstruct individual objects using explicit 1 ; 11 ; 15 or implicit 55 ; 57 ; 54 representations, while more recent efforts address full scene reconstruction 96 ; 9 ; 44 . Holistic reconstruction methods 13 ; 12 ; 87 ; 43 ; 92 recover the scene as a whole, often guided by depth estimation 40 ; 91 ; 4 and processed through encoder–decoder architectures. Compositional approaches 100 ; 44 ; 18 ; 19 reconstruct objects separately before assembling them via layout and pose estimation, as seen in DepR 96 and ComboVerse 9 . These reconstruction paradigms provide geometric priors and structural insights closely related to semantic scene completion. Serialization-Based Approaches. The recent serialization-based transformers 7 ; 67 ;