NURBGen: High-Fidelity Text-to-CAD Generation through LLM-Driven NURBS Modeling

Muhammad Usama, Mohammad Sadil Khan, Didier Stricker, Muhammad Zeshan Afzal · 2025

Read NURBGen: High-Fidelity Text-to-CAD Generation through LLM-Driven NURBS Modeling by Muhammad Usama, Mohammad Sadil Khan, Didier Stricker, Muhammad Zeshan Afzal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06194.txt.

Introduction

Muhammad Usama and colleagues introduce NURBGen, a system that turns plain text descriptions into editable three-dimensional CAD models. Earlier text-to-CAD tools produced fixed meshes or depended on rare design-history data. NURBGen instead generates models built from NURBS, the smooth mathematical surfaces that professional CAD software uses.

A fine-tuned large language model writes surface parameters such as control points, knot vectors, and weights as structured text, which converts directly into standard CAD format. A hybrid scheme adds simple solid shapes to handle trimmed surfaces cleanly. The authors also built partABC, a captioned dataset of single CAD parts, and expert checks favored NURBGen on shape fidelity and dimensions.

Catalog record

CREATORMuhammad Usama, Mohammad Sadil Khan, Didier Stricker, Muhammad Zeshan Afzal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06194

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NURBGen: High-Fidelity Text-to-CAD Generation through LLM-Driven NURBS Modeling Muhammad Usama, Mohammad Sadil Khan, Didier Stricker, Muhammad Zeshan Afzal Abstract Generating editable 3D CAD models from natural language remains challenging, as existing text-to-CAD systems either produce meshes or rely on scarce design-history data. We present NURBGen, the first framework to generate high-fidelity 3D CAD models directly from text using Non-Uniform Rational B-Splines (NURBS). To achieve this, we fine-tune a large language model (LLM) to translate free-form texts into JSON representations containing NURBS surface parameters ( i.e , control points, knot vectors, degrees, and rational weights) which can be directly converted into BRep format using Python. We further propose a hybrid representation that combines untrimmed NURBS with analytic primitives to handle trimmed surfaces and degenerate regions more robustly, while reducing token complexity. Additionally, we introduce partABC, a curated subset of the ABC dataset consisting of individual CAD components, annotated with detailed captions using an automated annotation pipeline. NURBGen demonstrates strong performance on diverse prompts, surpassing prior methods in geometric fidelity and dimensional accuracy, as confirmed by expert evaluations. Code and dataset will be released publicly. Introduction Computer-Aided Design (CAD) plays a fundamental role in modern engineering, product design, and digital manufacturing workflows ( 37 ; 8 ) . It enables precise, parametric modeling of complex mechanical and architectural components. However, creating detailed CAD models typically requires expert knowledge of professional design software-such as Onshape (https://www.onshape.com) or AutoCAD (https://www.autodesk.com/products/autocad/overview) , and remains a labor-intensive and, time-consuming task. Researchers have therefore proposed deep learning-based approaches for automatic CAD modeling from high-level inputs such as natural language ( 16 ) , images ( 3 ) , or point clouds ( 25 ) . Among these, text-to-CAD generation offers a simple, intuitive interface that allows designers to describe 3D objects in natural language, bypassing the need for expert modeling skills. However, nearly all prior methods ( 21 ; 14 ; 16 ) rely on design-history-based representations ( 42 ; 15 ; 51 ) , where shapes are constructed via sequences of parametric operations—extrusions, and 2D sketches. While intuitive and highly editable, these methods are trained on small-scale datasets like DeepCAD ( 42 ) , which mostly contain low-complexity parts (e.g., cuboids, cylinders), limiting generalization in real-world scenarios. Figure 1: Text-to-CAD generation results from NURBGen, showcasing reconstructed CAD models from text prompts. In contrast, the ABC dataset ( 17 ) , which contains over a million 3D CAD models, remains comparatively underutilized in text-to-CAD research due to two key limitations. First, ABC represents geometry in Boundary Representation (BRep) form, which lacks design history. BReps define solids using analytic surface patches—most commonly NURBS, the industry standard for their precision and parametric control. However, NURBS-based modeling is rarely explored in deep generative research due to the challenge of efficient representation ( 47 ) , non-differentiability of knot vectors ( 30 ) , high parameter variability, and trimming complexity inherent to NURBS geometry. NeuroNURBS ( 7 ) partially addresses this by learning latent codes for untrimmed NURBS surfaces via a non-autoregressive transformer VAE, but it does not support language-based generation and cannot model complex shapes due to the trimming issues. Second, ABC lacks high-quality text descriptions, making it difficult to train or evaluate text-conditioned generative models. In this work, we present NURBGen , the first framework for generating 3D CAD models from natural language using structured, symbolic NURBS representations. Unlike prior work that learns dense latent codes ( 7 ) , we treat each NURBS surface as a language-aligned object: a sequence of tokens encoding control points, degrees, weights, and knot vectors in JSON format. This allows us to formulate text-to-CAD as a language modeling task. We fine-tune a large language model (Qwen3-4B) to map textual descriptions to these NURBS parameters, producing outputs that are editable and directly compatible to BRep format. To support this, we construct partABC , a curated dataset of more than 300k part-level CAD models from the ABC dataset, each represented as a sequence of NURBS surfaces and serialized with manageable context lengths ( \leq 8k tokens). We also generate high-quality natural language descriptions of the CAD models using an automatic annotation pipeline for the supervised fine-tuning task. A key design choice to manage context length is our use of untrimmed NURBS surfaces similar to NeuroNURBS ( 7 ) . However, this introduces a limitation it cannot capture trimmed geometry precisely. To address this, we propose a hybrid symbolic representation that replaces NURBS with primitive analytic curves (e.g., circles, B-splines, arcs, and lines) to accurately model such faces. This maintains the structural format required for LLM fine-tuning and inference. Our experiments demonstrate that NURBGen can outperform the current state-of-the-art methods in high-fidelity text-to-CAD generation as shown in Figure 1 . Our contributions can be summarized as follows • We propose NURBGen, the first framework for LLM-driven NURBS-based text-to-CAD framework. • We introduce partABC, a large-scale multi-modal dataset of 300k CAD parts from the ABC dataset with NURBS annotations and high-quality captions using an automatic annotation pipeline. • We design a hybrid representation combining untrimmed NURBS with analytic primitives to accurately model trimmed and degenerate surfaces while maintaining structural compatibility for LLM fine-tuning. • Our extensive experiments demonstrate NURBGen’s superior performance over existing baselines. Related Work CAD Generation: Earlier approaches to CAD generation primarily focused on low-level geometry tasks such as surface fitting ( 35 ; 25 ) , point cloud classification ( 32 ; 31 ) , BRep segmentation ( 5 ; 20 ; 28 ) , or BRep structure prediction ( 11 ; 1 ) , rather than generating fully parametric CAD models. A major shift came with DeepCAD ( 42 ) , which introduced a design-history-based representation where CAD models are expressed as sequences of 2D sketches and 3D operations (e.g., extrusions). This formulation enabled sequence-to-sequence modeling of CAD generation. Building on this, later works explored cross-modal CAD synthesis from point clouds ( 15 ; 6 ; 34 ) , images ( 3 ) , natural language ( 21 ; 27 ; 16 ; 23 ; 9 ; 38 ) , or combinations thereof ( 18 ; 43 ) . While design-history representations are highly interpretable and editable, their reliance on proprietary CAD operation data presents a major bottleneck for large-scale public research. Public datasets like DeepCAD-170k ( 42 ) , Fusion360-8k ( 40 ) , and CADParser-50k ( 51 ) are limited in size and complexity, often consisting of simple, synthetic parts ( 9 ) , which restricts generalization to real-world scenarios. Alternative approaches for CAD generation operate directly on BRep geometry ( 19 ) or leverage SDF supervision ( 33 ; 22 ; 48 ) . However, these methods don’t generalizes well. Recent work BrepGen ( 45 ) , for example, generates BRep topology including vertices, edges, and faces via a hierarchical latent diffusion model. In contrast, we represent BReps as sequences of structured NURBS surfaces, allowing us to frame text-to-CAD as a language generation task. This enables fine-tuning an LLM on partABC, which is more diverse and larger than those used in prior work. Figure 2: Overview of our partABC dataset, data preparation and fine-tuning pipeline. Left: We extract part-level CAD models from the ABC dataset by decomposing CAD assemblies into

Read the complete text