Learning From Design Procedure To Generate CAD Programs for Data Augmentation
Yan-Ying Chen, Dule Shu, Matthew Hong, Andrew Taber, Jonathan Li, Matthew Klenk · 2026
Read Learning From Design Procedure To Generate CAD Programs for Data Augmentation by Yan-Ying Chen, Dule Shu, Matthew Hong, Andrew Taber, Jonathan Li, Matthew Klenk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06894.txt.
Introduction
Chen and colleagues prompt an LLM to write CAD programs from a reference shape plus modeling steps, adding to scarce training data. CAD programs are scripted parametric models for precise design and making, yet LLM outputs lack the shape complexity of real factory designs. The shortfall traces partly to narrow training data. Varying the reference shape with organic shapes widens the spread of new programs, giving the model richer examples to learn from.
Catalog record
| CREATOR | Yan-Ying Chen, Dule Shu, Matthew Hong, Andrew Taber, Jonathan Li, Matthew Klenk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34878 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.06894
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning From Design Procedure To Generate CAD Programs for Data Augmentation Yan-Ying Chen, Dule Shu, Matthew Hong, Andrew Taber, Jonathan Li, Matthew Klenk Abstract Large Language Models (LLMs) have demonstrated impressive capabilities in a wide range of code generation tasks. However, generating code for certain domains remains challenging. One such domain is Computer-Aided Design (CAD) program, where the goal is to produce scripted parametric models that define object geometry for precise design and manufacturing applications. A key challenge in LLM-based CAD program generation is the limited geometric complexity of generated shapes compared to those found in real-world industrial designs. This shortfall is in part due to the lack of diversity in the available CAD program training data. To address this, we propose a novel data augmentation paradigm that prompts an LLM to generate CAD programs conditioned on a reference surface program and a modeling procedure - an idea inspired by practices in industrial design. By varying the reference surface using a collection of organic shapes, our method enriches the geometric distribution of generated CAD models. In particular, it introduces edges and faces defined by spline-based curvature, which are typically missing or underrepresented in existing open-source CAD program datasets. Experiments show that our method produces CAD samples with significantly greater geometric diversity and a higher resemblance to industry-grade CAD designs in terms of the proportion of organic shape primitives. This enhancement makes our CAD data augmentation approach a useful tool for training LLMs and other deep learning models in CAD generation. \workshoptitle Deep Learning for Code in the Agentic Era 1 Introduction Figure 1: It is common to use a reference surface to guide CAD creation for specific design intent, e.g., compatibility to other component. Motivated by this idea, we propose to a new design procedure prompting to guide the CAD program generation toward more organic shapes. Computer-Aided Design (CAD) is important for product design and engineering because it carries high-fidelity, parametric 3D information such as parts and topological structures that are essential for engineering and manufacturing physical products. Designers have been using CAD software, e.g., Solidworks and Fusion 360, to create CAD models through a sequence of operations such as sketch and extrude. These operations can be interpreted to different formats of CAD model representation (e.g., B-rep, boundary representation, in a STEP file) or 3D artifacts (e.g., mesh in a STL file) for a variety of downstream work such as physical simulation 19 and shape optimization 13 . CAD is a classic example of visual programming, where a CAD program is created by a sequence of operations that define a 3D shape. As a vital step towards automated CAD programming, larger CAD program datasets 26 ; 25 have been proposed for training CAD program generation models. However, it is much more challenging to scale up than other visual data formats such as images or videos, because CAD programming involves multiple modalities and requires domain-specific expertise 8 to create data. In addition, CAD data are mostly in closed systems and spread across different CAD tools without organically growing data sources similar to repositories for software programming, e.g., GitHub. Hence, the existing CAD program datasets are mostly limited in a small set of operation commands and result in simple CAD data that are far from industrial designs 9 . We argue that a key recipe for scaling is a sustainable eco-system to synthesize CAD programs for data augmentation. We leverage recent efforts in bridging CAD programming to generic programming languages, such as the python script libraries CadQuery 2 and Build123d 1 1 1 https://github.com/gumyr/build123d . This exciting progress enables the application of LLM-based knowledge of common programming languages (e.g., python) to CAD programming. This advantage drives the trend of finetuning approaches 20 ; 27 ; 4 built upon those libraries and LLMs. This trend brings a turning point of architecting a data simulation and augmentation system to scale up the data needed for training CAD generation models. However, how to prompt these LLMs to simulate the CAD design process and synthesize data with geometric properties similar to industrial design standards remains an underexplored topic. Like software engineers, CAD engineers/designers embed deep expertise and tacit knowledge in both the design processes and domains they operate in. A common strategy used by CAD designers is a modeling procedure where they create a sequence of operations from a chosen reference surface; for example, a wall that a bracket is supposed to support as illustrated the left in Figure 1 . The reference surface significantly impacts the resulting design because the sequential operations can create ripple effects, e.g., all curves adjacent to a surface must align with a part of its curvature. Hence, an internal bracket may comprise organic shapes (e.g., free form B-Spline shapes) in addition to standard primitives (e.g., flat rectangles and cylinders) because it needs to match the design’s exterior. In addition, designers use field-specific design languages (e.g., double-spoke, Y-spoke, the number of spokes in a car wheel) to guide their design creation 24 . These semantically encoded design patterns hold significant meaning for industrial design practices as they embody human-interpretable representations that play a critical role in making the generated program align more closely with design intent. The combination of reference surface, design language and procedure constitute a multimodal expression to bridge human creativity and computer-aided design, enabling a more seamless translation between conceptual ideas and visual form. Inspired by this design scenario, we propose a designer-centered data augmentation paradigm by leveraging (1) a reference surface program prompt and (2) a design procedure prompt to synthesize CAD programs with more organic shapes. Our experiments demonstrate that, in comparison to the benchmark CAD program datasets, the CAD programs generated by our approach, after being interpreted to 3D CAD B-rep format, have improved diversity of shape complexity. In addition, the geometric properties (e.g., B-Spline ratio) of our generated data are more similar to those of industrial-grade CAD designs. Finally, our ablation study highlights the importance of the proposed reference surface prompt in driving the generation of B-Spline shapes and the advantage of program modularization for reflecting the proposed design procedures. 2 Related Work CAD program generation 26 ; 23 ; 1 ; 20 ; 27 has gained increased attention for generating 3D CAD designs. While parallel efforts such as primitive fitting 16 ; 17 and B-rep generation models 28 ; 11 are focused on 3D shape and topology representation, CAD program describes a CAD design as a sequence of design operations, and is more programmable and convertible to other CAD representation formats. Earlier works such as Fusion360 25 , DeepCAD 26 , and GenCAD 29 leverage Domain Specific Languages (DSLs) (e.g., FeatureScript 5 , structured text representation 30 , CAD assembly JSON 8 ) to parse CAD operations and parameters. Based on a DSL, the generation of CAD programs can be performed by a deep reinforcement learning agent 21 or by a generative model such as GAN 6 and diffusion model 7 in a latent space learned by a transformer 22 . In addition, DSLs have been used to fine-tune LLMs for text-to-CAD generation 23 ; 8 and VLMs for CAD generation conditioned by image and text 1 ; 27 . To improve the