Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure

Xiang Chen, Alexander Binder · 2026

Read Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure by Xiang Chen, Alexander Binder (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10438.txt.

Introduction

Xiang Chen and Alexander Binder argue that 3D tokenization has the wrong job description. Current 3D tokens treat encoding as spatial compression: compact codes rebuild surface geometry but leave part owners and join validity implicit. In open-world assets with intersecting parts and noisy topology, local shape, part identity, and assembly tangle. Their 2026 paper proposes interface-first generative states instead.

In that view, tokens build a working state, not a passive code, exposing geometry, owners, and joins to query, constrain, and repair during decoding. The authors build it with Component-Conditioned Canonical Local Tokens, or C2LT-3D, splitting it into standard geometry, group context, and seam factors. Each factor targets a distinct failure: pose leakage, cross-part interference, or invalid local joins. Trained on single-object CAD models, tested zero-shot on open-world assets, C2LT-3D improved robustness, with latent variables usable under adversarial joins.

Catalog record

CREATORXiang Chen, Alexander Binder
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE116 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10438

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure Xiang Chen, Alexander Binder Abstract Current 3D tokenizers largely treat representation as spatial compression: compact codes reconstruct surface geometry, but leave component ownership and attachment validity implicit. In open-world assets with intersecting components, noisy topology, and weak canonical structure, this creates a representation mismatch: local shape, component identity, and assembly relations become entangled in a latent stream and are not natively addressable during decoding. We formulate an alternative view, interface-centric generative states , in which tokenization constructs an operational state rather than a passive compressed code. The state exposes local geometry, component ownership, and attachment validity as variables that can be queried, constrained, and repaired during decoding. We instantiate this formulation with Component-Conditioned Canonical Local Tokens (C2LT-3D), factorizing representation into canonical local geometry, partition-conditioned context, and relational seam variables. Each factor targets a distinct failure mode of compression-centric tokens: pose leakage, cross-component interference, or invalid local attachment. This exposed state supports attachment validation, latent structural repair, targeted intervention, and constrained serialization without a separate post-hoc structure recovery module. Trained on single-object CAD models and evaluated zero-shot on open-world multi-component assets, C2LT-3D improves structural robustness and shows that its latent variables remain actionable under adversarial attachment settings. These results suggest that open-world 3D generative representations should be evaluated not only by reconstruction fidelity, but by whether their discrete states remain operational for assembly-level structural reasoning. 1 Introduction Discrete tokenization has transformed language because tokens are not merely compressed observations; they are units over which syntax, semantics, and reasoning can be expressed. In 3D generation, however, tokenization is still largely treated as spatial compression : recent mesh and surface tokenizers ( 16 ; 21 ; 25 ; 7 ) map geometry to short discrete sequences for autoregressive modeling. This works well on clean, single-component CAD objects such as ShapeNet ( 1 ) , but is less reliable on open-world assets from Objaverse and Objaverse-LVIS ( 6 ; 5 ) , where objects contain intersecting components, non-manifold interiors, arbitrary scale, and weak canonical orientation. We argue that this limitation reflects a representation mismatch. Compression-centric tokens treat an asset as arbitrarily divisible geometry, while many open-world objects behave more like assemblies whose local shape, component identity, and attachment structure must remain distinguishable. We therefore propose an interface-centric generative-state paradigm for open-world 3D structure (Figure 1 ): a model should not only predict compressed geometry tokens, but construct an operational structural state in which geometry, ownership, and attachment relations remain explicit throughout decoding. We use “paradigm” operationally: a generative representation defines a paradigm when it determines not only how objects are encoded, but what operations are available during generation. Compression-centric tokens primarily support reconstruction from a passive latent stream; interface-centric generative states additionally support attachment validation, latent repair, intervention, and constraint-aware decoding. Thus tokenization becomes a choice of state variables, and those variables determine which structural operations are native rather than recovered after decoding. Figure 1: From Compression Tokens to Interface-Centric Generative States. (a) Compression-first tokenization flattens complex 3D assets into generic patch sequences, leaving assembly variables implicit and exposing open-world assets to structural errors. (b) C2LT-3D exposes local geometry, component context, and seam relations as a generative state rather than a compressed token stream, enabling object-level realization, latent repair, structural intervention, and controlled decoding. Our central hypothesis is that open-world structural errors arise because intrinsic local shape, macro-component membership, and local assembly are entangled inside compression-centric tokens. We introduce Component-Conditioned Canonical Local Tokens ( C2LT-3D ), an interface-centric generative-state representation that separates these variables without semantic part annotations. The state combines Canonical Local Geometry , which stabilizes local frames so the codebook captures shape rather than pose variants; Partition-Conditioned Context , which injects unsupervised macro-component ownership as a soft structural bias; and a Relational Seam Prior for Controlled Decoding , which scores physical compatibility, refines relative transforms, and predicts collision risk between adjacent tokens. A deterministic Component-Owned Object Realization map resolves the local-to-global decode mismatch by suppressing cross-component leakage during object reconstruction and mesh visualization. Contributions and scope. We formulate open-world 3D tokenization as construction of an operational generative state , identifying a mismatch between geometry fidelity and assembly-level validity. C2LT-3D instantiates this state with a compact factorization into canonical local geometry, partition-conditioned context, and relational seams; each factor targets a distinct failure mode of compression-centric tokens. We then show that the resulting variables are addressable for attachment validation, latent repair, structural intervention, and constrained decoding without a separate post-hoc structure recovery module. The goal is not unconditional generation alone, but whether tokens expose repairable assembly-level variables. We therefore evaluate C2LT-3D through zero-shot transfer to open-world multi-component assets, latent-space repair and targeted intervention, and controlled serialization under a fixed lightweight decoder. Across these settings, C2LT-3D supports the view that open-world 3D generative states should be judged not only by surface fidelity, but by whether their discrete variables remain actionable for assembly-level reasoning. 2 Related Work Compression-centric 3D tokenization. Discrete latent-variable models ( 22 ; 8 ) are now central to generative modeling. In 3D, PolyGen ( 16 ) , MeshGPT ( 21 ) , BPT ( 25 ) , LoST ( 7 ) , MeshAnythingV2 ( 2 ) , and MeshArt ( 10 ) all reduce geometry to compact token sequences or local blocks for efficient generation. These methods are powerful on clean CAD domains, but their compression objective makes component identity and attachment structure implicit. C2LT-3D instead treats tokenization as construction of an interface-centric generative state: local shape, component ownership, and seam compatibility are represented separately so they can be evaluated and repaired. Structural and relational 3D representations. Part-based methods based on PartNet ( 15 ) , StructureNet ( 14 ) , BSP-Net ( 3 ) , or direct geometric proxy fitting ( 18 ) demonstrate the value of compositional structure, but often require semantic annotations or category-specific assumptions. LLM-assisted mesh reasoning ( 9 ; 24 ) offers another route but delegates structure to external language priors. Our goal is different: C2LT-3D learns from geometry alone, using unsupervised partitions and a seam prior to expose a discrete generative state for attachment ranking, latent repair, and structural intervention. Canonicalization and assembly constraints. Canonical frames can stabilize 3D learning ( 19 ; 17 ) , but purely global or PCA-based local frames are fragile for symmetric, planar, or noisy patches. We use partial canonicalization with explicit fallbacks to improve token reuse, and we embed local assembly constraints into the latent state in the spirit of computational fabrication ( 4 ) . We do not claim that semantic concepts such as wheels or supports automatically emerge; rather, we provide an operational state on which geometric and relational structure can be measured directly. 3 An Interface-Centric Generative State Space Let an open-world asset \mathcal{M} be represented by localized surface charts \{c_{i}\}_{i=1}^{N} , where each chart has a spatial support, a local frame, and neighboring candidate contacts. A compression-centric tokenizer would map the asset to a flat sequence of geometry codes and leave component membership or attachment validity implicit. Our goal is different: the generative representation should remain operational , answering three decoding-time queries: what local shape a chart contains, which macro-component owns it, and which neighboring charts

Read the complete text