AutoRegressive Generation with B-rep Holistic Token Sequence Representation

Jiahao Li, Yunpeng Bai, Yongkang Dai, Hao Guo, Hongping Gan, Yilei Shi · 2026

Read AutoRegressive Generation with B-rep Holistic Token Sequence Representation by Jiahao Li, Yunpeng Bai, Yongkang Dai, Hao Guo, Hongping Gan, Yilei Shi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16771.txt.

Introduction

Jiahao Li, Yunpeng Bai, Yongkang Dai, Hao Guo, Hongping Gan, and Yilei Shi build a new way to make 3D parts by machine. Parts in design files are stored as B-reps. A B-rep lists the faces, edges, and links of a solid. Past AI tools split shape and links into two tracks. That split blocked the use of text-style AI models.

Their 2026 preprint packs the whole B-rep in one token chain. Text-style models can then learn and make parts in one flow. The chain keeps both shape and links in full. This could let firms draft parts from prompts. It could also speed search in vast part stores.

Catalog record

CREATORJiahao Li, Yunpeng Bai, Yongkang Dai, Hao Guo, Hongping Gan, Yilei Shi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16771

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AutoRegressive Generation with B-rep Holistic Token Sequence Representation Jiahao Li, Yunpeng Bai, Yongkang Dai, Hao Guo, Hongping Gan, Yilei Shi Abstract Previous representation and generation approaches for the B-rep relied on graph-based representations that disentangle geometric and topological features through decoupled computational pipelines, thereby precluding the application of sequence-based generative frameworks, such as transformer architectures that have demonstrated remarkable performance. In this paper, we propose BrepARG , the first attempt to encode B-rep’s geometry and topology into a holistic token sequence representation, enabling sequence-based B-rep generation with an autoregressive architecture. Specifically, BrepARG encodes B-rep into 3 types of tokens: geometry and position tokens representing geometric features, and face index tokens representing topology. Then the holistic token sequence is constructed hierarchically, starting with constructing the geometry blocks (i.e., faces and edges) using the above tokens, followed by geometry block sequencing. Finally, we assemble the holistic sequence representation for the entire B-rep. We also construct a transformer-based autoregressive model that learns the distribution over holistic token sequences via next-token prediction, using a multi-layer decoder-only architecture with causal masking. Experiments demonstrate that BrepARG achieves state-of-the-art (SOTA) performance. BrepARG validates the feasibility of representing B-rep as holistic token sequences, opening new directions for B-rep generation. Figure 1 : BrepARG is the first approach to encode the geometry and topology of a B-rep into a holistic token sequence, enabling efficient modeling and generation via an autoregressive model. 1 Introduction Boundary Representation (B-rep) Weiler 1986 is a fundamental paradigm in Computer-Aided Design (CAD) for representing solid models. Recent progress in B-rep data generation Xu et al. 2024 ; Li et al. 2025 ; Jayaraman et al. 2022 ; Guo et al. 2025 has advanced the automation and learning of CAD modeling processes. However, B-rep structures are inherently complex: they combine heterogeneous geometric primitives (parametric faces, edges, and vertices) within hierarchical topological dependencies. This heterogeneity makes it difficult to encode B-rep data in a direct, holistic form suitable for deep generative modeling. Existing methods fall short in representing geometric and topological features holistically. They generally rely on stage-wise learning paradigms that separately model geometry and topology Xu et al. 2024 ; Li et al. 2025 ; Jayaraman et al. 2022 , or employ multi-component architectures for different elements Guo et al. 2025 . Such designs lead to fragmented representations and increased model complexity. Moreover, graph-based formulations Xu et al. 2024 ; Guo et al. 2025 constrain the use of efficient transformer-based architectures that require sequential inputs, while multi-stage approaches Li et al. 2025 ; Jayaraman et al. 2022 limit the model’s ability to capture the full heterogeneity and interdependence inherent in B-rep. To holistically represent B-rep, in this work, we propose a B-rep A uto R egressive G eneration ( BrepARG ) framework, based on a novel holistic token sequence representation . The core idea is to encode the complete geometry and topology of a B-rep as a single token sequence, enabling direct autoregressive modeling (see Figure 1 ). The token sequence representation comprises holistic tokenization and sequence construction (see Figure 2 ). For tokenization, geometry and topology of faces and edges are discretized separately, forming 3 types of tokens. The geometry primitives, i.e., faces and edges, are UV-sampled and tokenized into Geometry Tokens by mapping their vector-quantized variational autoencoder (VQ-VAE) encoder latents to codebook indices via nearest neighbor search. The 3D positions, i.e., bounding boxes, are encoded into Position Tokens through a newly designed uniform scalar quantization algorithm. The topology information is explicitly represented through shared Face Index Tokens . For sequence construction, we first construct geometry blocks, each consisting of all 3 types of tokens and representing a face or an edge. Then we use a topology-aware sequentialization scheme to sequence all face and edge blocks respectively, forming the face and edge block sequences, enforcing causal ordering while preserving local structural relationships. Finally, we assemble face block sequence and edge block sequence, together with necessary markers, to form the final holistic sequence representation. To better leverage the powerful autoregressive framework, BrepARG then employs a transformer-based autoregressive model to learn the holistic geometric-topological token sequence via the next-token prediction task, thereby learning their joint distribution. This design enables the model to co-generate geometric shapes and topological connections in a single stream, achieving end-to-end autoregressive generation of B-rep sequences. Experiments demonstrate that BrepARG achieves state-of-the-art (SOTA) performance in B-rep generation while maintaining high efficiency, requiring only about 1.2 days to train on DeepCAD Wu et al. 2021 with 4 NVIDIA H20 GPUs and around 1.5 seconds per B-rep for inference on a single RTX 4090. With BrepARG, we make the following contributions: • We propose a novel holistic token sequence representation for B-rep, encoding both geometric and topological information into a single token sequence, addressing the long-standing fragmentation between geometry and topology in traditional approaches. • We develop an autoregressive framework for B-rep generation that holistically learns geometric and topological structures through self-attention, eliminating multi-stage pipelines and improving efficiency. • We conduct experiments to show that BrepARG achieves SOTA performance on B-rep generation tasks. Figure 2 : Our Holistic Token Sequence Representation comprises two parts: 1) Holistic Tokenization : Geometry Tokens are constructed by mapping VQ-VAE encoder latents to the codebook. Position Tokens are constructed by applying uniform scalar quantization to bounding boxes (Bboxes). Face Index Tokens , used for conveying topology information, are constructed by assigning an index to each face. 2) Sequence Construction : We first assemble face and edge blocks using the three token types above. These blocks are then ordered independently using DFS and the MAX-IDX-A algorithm. Finally, the ordered face and edge block sequences are concatenated with a separator and wrapped with start/end-of-sequence markers, producing the holistic token sequence representation of the entire B-rep model. 2 Related work 2.1 CAD Generation Early CAD generation methods predominantly used Constructive Solid Geometry (CSG) Du et al. 2018 ; Yu et al. 2023 ; Sharma et al. 2018 ; Ren et al. 2021 ; Kania et al. 2020 ; Yu et al. 2022a , constructing models via Boolean operations on simple primitives, which limits their ability to represent complex geometries. Another line of work Wu et al. 2021 ; Xu et al. 2022 ; Li et al. 2023 ; Xu et al. 2023 ; Deng et al. 2025 learns parametric CAD command sequences that capture sketch structures, extrusion parameters, and action orderings to synthesize 3D shapes. Yet the development of this approach is currently limited by two main factors: 1) difficulty in supporting complex CAD design commands, 2) a persistent scarcity of high-quality, large-scale datasets. 2.2 B-rep Generation B-rep represents objects by combining parametric geometric primitives with topological relationships, serving as a fundamental representation in industrial CAD. Prior work Jayaraman et al. 2021 ; Fan et al. 2024 ; Wu et al. 2024 ; Lee et al. 2023 ; Hou et al. 2023 ; Dai et al. 2025 has studied B-rep classification and segmentation. For direct B-rep generation, Xu et al. 2024 ; Jayaraman et al. 2022 employ multistage models for geometry learning and use multi-level pointer networks or tree structures to incrementally construct topology. DTGBrepgen Li et al. 2025 disentangles topology and geometry learning by employing separate networks to model topological structures and geometric

Read the complete text