CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generation

Zheyuan Zhou, Jiayi Han, Liang Du, Naiyu Fang, Lemiao Qiu, Shuyou Zhang · 2025

Read CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generation by Zheyuan Zhou, Jiayi Han, Liang Du, Naiyu Fang, Lemiao Qiu, Shuyou Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04002.txt.

Introduction

Zheyuan Zhou and five co-authors build a strict judge for machines that turn words into CAD models, in a 2025 paper. Text-to-CAD tools draft editable 3D parts from a sentence, but grading their output is slow and costly. Rendering each draft takes time, and paying vision models to grade invites gaming that rots quality. The team's judge instead uses the CAD compiler itself as the grader.

A compiler score is fast and hard to fake, and a prospect-based tune pushes drafts toward useful, valid forms. A second compiler pass then reviews finished drafts and sends flaws back for repair, in an agent loop. On hard CAD test sets the system set top marks while staying quick. The authors frame compilers as built-in truth tellers for design AI.

Catalog record

CREATORZheyuan Zhou, Jiayi Han, Liang Du, Naiyu Fang, Lemiao Qiu, Shuyou Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04002

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generation Zheyuan Zhou, Jiayi Han, Liang Du, Naiyu Fang, Lemiao Qiu, Shuyou Zhang Abstract Computer-Aided Design (CAD) models are widely used across industrial design, simulation, and manufacturing processes. Text-to-CAD systems aim to generate editable, general-purpose CAD models from textual descriptions, significantly reducing the complexity and entry barrier associated with traditional CAD workflows. However, rendering CAD models can be slow, and deploying VLMs to review CAD models can be expensive and may introduce reward hacking that degrades the systems. To address these challenges, we propose CAD-Judge, a novel, verifiable reward system for efficient and effective CAD preference grading and grammatical validation. We adopt the Compiler-as-a-Judge Module (CJM) as a fast, direct reward signal, optimizing model alignment by maximizing generative utility through prospect theory. To further improve the robustness of Text-to-CAD in the testing phase, we introduce a simple yet effective agentic CAD generation approach and adopt the Compiler-as-a-Review Module (CRM), which efficiently verifies the generated CAD models, enabling the system to refine them accordingly. Extensive experiments on challenging CAD datasets demonstrate that our method achieves state-of-the-art performance while maintaining superior efficiency. Introduction Computer-Aided Design (CAD) has become an essential tool in modern industrial design and manufacturing, enabling the precise modeling of complex geometries ( Robertson and Allen 1993 ; Cherng et al. 1998 ; Yamamoto and Nakakoji 2005 ; Deng, Chen, and Olechowski 2024 ; Khan et al. 2024a ) . Traditional workflows involve manually creating 2D sketches using basic primitives such as lines, arcs, and circles, which are then extruded into 3D solid models. While this process is powerful, it demands significant expertise and iterative refinement, often limiting accessibility for non-expert users. To democratize CAD modeling, recent efforts have focused on text-to-CAD systems—approaches that aim to automate the generation of parametric command sequences directly from natural language descriptions ( Khan et al. 2024b ; Li et al. 2024 ; Wang et al. 2025a ) . Such systems allow both professionals and hobbyists to rapidly prototype editable CAD models through intuitive text instructions, significantly reducing the time and effort required for manual construction. Current approaches typically rely on end-to-end Transformer-based architectures trained on paired datasets of textual commands and corresponding CAD sequences ( Li et al. 2024 ; Khan et al. 2024b ) . These models are often trained from scratch, resulting in slow convergence and suboptimal performance. Moreover, limited model capacity restricts their ability to interpret nuanced or complex design instructions. Recent works attempt to address this by integrating pre-trained large language models (LLMs), leveraging their strong language understanding capabilities and general knowledge of CAD principles ( Wang et al. 2025a ) . Figure 1: Comparison between existing preference data construction pipelines and ours. (a) Existing Vision-Language Model (VLM)-based methods rely on costly multi-sample rendering and projection for score grading. (b) Our method leverages per-sample preferences derived from a native quantifiable CAD compiler, enabling efficient and scalable data collection. The “ > ” symbol denotes pairwise preferences, where one item is selected as superior from a ranked list, while the thumbs-down icon indicates independent binary negative preferences without explicit pairing. (c) Existing direct CAD sequence generation methods output the final CAD sequence directly through LLMs. (d) Our approach incorporates feedback on erroneous samples, enabling the model to correct obvious mistakes and iteratively generate the final CAD sequence. However, aligning these models with human preferences remains a major hurdle. As shown in Figure 1 , most existing methods depend on pairwise preference data—comparisons between preferred and rejected CAD outputs generated from the same prompt ( Wang et al. 2025a ) . Constructing such data is costly, requiring rendering and ranking multiple generations per prompt via VLMs. Additionally, LLM-generated CAD sequences often fail to conform to strict syntactic rules, leading to high invalidation rates during compilation. To address these limitations, we introduce CAD-Judge , a novel verifiable reward system for efficient and effective CAD preference grading and grammatical validation. Unlike conventional methods that rely on Vision-Language Models (VLMs) and their dependence on rendered images, our approach leverages per-sample binary feedback obtained via a Compiler-as-a-Judge Module (CJM). Specifically, our CJM employs the Chamfer Distance (CD) between generated and ground-truth CAD models as a fast, interpretable reward signal—obviating the need for computationally costly rendering and ranking procedures. Furthermore, to improve the robustness of LLM-generated sequences, we introduce the Compiler-as-a-Review Module (CRM), which efficiently verifies the generated CAD models, allowing the LLMs to modify them. By monitoring compilation outcomes and performing intelligent adjustments based on error diagnostics, this scaling strategy significantly boosts the likelihood of generating valid, executable CAD programs without incurring substantial computational overhead. Our key contributions are summarized as follows: • An efficient Compiler-as-a-Judge Module (CJM) for constructing per-sample binary preference data using CJ-derived rewards. • A paradigm grounded in prospect theory that directly optimizes the alignment of generated CAD command sequences by maximizing generative utility. • A Compiler-as-a-Review Module (CRM) that efficiently reviews the LLM-generated CAD sequences during test time for robust CAD generation. • Extensive experimental evaluations on various datasets demonstrating that CAD-Judge achieves state-of-the-art performance on text-to-CAD tasks while maintaining high computational efficiency. Related Workers CAD Generation. CAD, depending on its representation methods, can be categorized into constructive solid geometry (CSG) ( Du et al. 2018 ; Kania, Zieba, and Kajdanowicz 2020 ; Yu et al. 2022 ; Yu et al. 2023 ) , boundary representation (B-rep) ( Jayaraman et al. 2022 ; Wang, Zheng, and Zhou 2022 ; Xu et al. 2024 ) , and sketch-and-extrude modeling (SEM) ( Willis et al. 2021a ; Wu, Xiao, and Zheng 2021 ) . Our research primarily focuses on SEM, which records the drawing history of a CAD model, starting from curves, progressing to 2D sketches, and ultimately culminating in the extrusion to form a 3D model. DeepCAD ( Wu, Xiao, and Zheng 2021 ) was the pioneer in proposing a sketch-extrusion construction sequence representation for CAD models. In a preliminary experiment, it predicted the CAD history from latent vectors or point clouds. CAD Translator ( Li et al. 2024 ) utilize an encoder-decoder architecture. By aligning the encoded CAD Embedding with the Text Embedding, the model acquires the ability to generate CAD sequences from text. After the fusion process, the embeddings are fed into the decoder to recover 3D parametric CAD sequences. Text2CAD ( Khan et al. 2024b ) trains an end-to-end transformer-based autoregressive network to generate parametric CAD models from input texts. ( Yavartanoo et al. 2024 ) employs images as an intermediate medium and realizes the generation in multiple steps. Specifically, the text is transformed into an isometric image that represents the described features. Subsequently, this image is mapped into orthographic technical drawings, which serve as the basis for generating the 3D CAD model. CAD-GPT ( Wang et al. 2025b ) introduces a Multimodal Large Language Model (MLLM) that can precisely synthesize CAD modeling sequences from either a single image or a textual description. The CAD-MLLM has the capability to generate parametric CAD models based on multimodal inputs, such as text, images, point clouds, or a combination of these modalities. CAD-Coder ( Guan et al. 2025 ) fine-tunes LLMs to generate CadQuery scripts for building CAD models by incorporating GRPO

Read the complete text