Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback
Guijin Son, Jehyun Park, Seyeon Park, Sunghee Ahn, Youngjae Yu, Seoul National University, OneLineAI, Sungkyunkwan University, Ewha Womans University [email protected]@g.skku.edu · 2026
Read Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback by Guijin Son, Jehyun Park, Seyeon Park, Sunghee Ahn, Youngjae Yu, Seoul National University, OneLineAI, Sungkyunkwan University, Ewha Womans University [email protected]@g.skku.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17448.txt.
Introduction
Son and colleagues recast CAD generation as an industry-native task. Models must produce a fully built multi-part STEP document from a free-form note, then validate it by finite element analysis. First-attempt sweeps find leading agents produce no strict-passing artifact, meeting only about a fifth of typed requirements at best. Two new feedback signals, a text-only blueprint plan and a 21-view image renderer, lift geometric reconstruction markedly on S2O and Fusion360.
Catalog record
| CREATOR | Guijin Son, Jehyun Park, Seyeon Park, Sunghee Ahn, Youngjae Yu, Seoul National University, OneLineAI, Sungkyunkwan University, Ewha Womans University [email protected]@g.skku.edu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83117 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback Guijin Son, Jehyun Park, Seyeon Park, Sunghee Ahn, Youngjae Yu, Seoul National University, OneLineAI, Sungkyunkwan University, Ewha Womans University [email protected]@g.skku.edu Abstract Computer-aided design (CAD) is the backbone of modern industrial design, yet learned CAD generators still fall short of real engineering pipelines: they neither iterate like engineers nor evaluate what engineering requires. Prior work has treated CAD generation as two disjoint steps, part synthesis and assembly, where the former is graded by proximity to a gold reference and the latter, when handled at all, is reduced to a separate constraint solving step. In this work, we introduce a more industry-native task formulation that requires a model to produce a fully assembled multi-part STEP file from a free-form engineering brief, which is then validated via finite element analysis (FEA). FEA validation reveals that Codex (GPT-5.5) and Claude Code (Opus-4.7) agents do not produce a single strict-passing artifact in the main first-attempt sweep, with the best configuration meeting only about 20% of typed requirements on average. Moreover, we introduce two additional supervision signals, a novel text-only blueprint schema and a 21-view image renderer that aids the agent’s visual inspection, that better align the generation loop with how engineers iterate in practice. On S2O and Fusion 360 , the same feedback tools improve geometric reconstruction, with GPT-5.5/xhigh rising from 0.444 to 0.592 Box-IoU on S2O and from 0.397 to 0.505 on Fusion 360 . Together these signals move CAD programs toward artifacts that are not only visually plausible but also checked against physical and structural requirements. Figure 1: Repeated engineering feedback turns test-time compute into better CAD artifacts. (A) Longer feedback loops steadily improve partial credit on Hephaestus-CCX as average model time scales from about 10 minutes to nearly 70 minutes per item. Mean requirement pass is the average per-case fraction of typed requirements satisfied. See Section 6 for scaling setup and qualitative details. (B–D) Successful retries show three repair modes. The launcher(B) removes fragile over-detailed geometry and routes load through a simpler stiff body. The column (C) adds bracing and section stiffness to recover axial capacity. The spacecraft panel (D) keeps a similar exterior shape, but fixes hidden density and mass-property errors. 1 Introduction Recent learned CAD systems have made substantial progress in text-to-part generation, CAD-code synthesis, and assembly [ 16 , 19 , 32 , 18 , 21 , 29 , 15 ] . These systems show that large models can translate natural language into executable modeling programs and plausible geometry. However, the dominant formulation remains weakly coupled to engineering validity. Outputs are commonly graded by distance to a reference shape [ 31 , 17 , 8 , 24 ] , rendered visual plausibility [ 2 , 9 , 16 , 22 , 20 ] , topological validity [ 12 , 4 ] , or mate prediction between parts that already exist [ 29 , 15 , 30 ] . These signals miss failures that make a design unusable, such as a misplaced interface, insufficient clearance, an invalid load path, or a selector that cannot support downstream analysis. We therefore reframe CAD generation as an iterative tool-using process. An LLM agent writes a CadQuery program, executes it to export a STEP artifact, receives structured feedback from rendering, validation, and simulation tools, and revises the program and selector metadata before the next attempt. Our loop adds two agent-side tools, a structured blueprint and rich-view visual inspection, together with finite-element feedback from CalculiX [ 7 ] . We equip this loop with a pre-CAD blueprint stage. The blueprint records the design commitments that the agent must satisfy when writing CAD. It constrains geometry to auditable parametric primitives, fixes envelopes and interfaces before code is emitted, and exposes dimensional and functional claims for validators and retry feedback. Once the agent generates CAD from this blueprint, the rich-view image judge renders the STEP from 21 calibrated views, including exterior views, close-ups, and internal x-ray cuts. This is a large increase over the small 4–6 render sets commonly used in visual CAD-code evaluations [ 2 , 9 , 16 , 22 , 20 ] , and it is meant to give the agent the static equivalent of walking around the assembly, zooming into interfaces, and taking section cuts. The agent can use these image reviews to fix visible geometry, assembly, and selector errors before final submission. Once the agent reports that the design is ready, an external FEA loop performs the analysis step that an engineer would run after inspection. It meshes the candidate design, runs CalculiX, and returns typed failures over stress, displacement, modal, buckling, contact, and clearance requirements. In our setting, the agent is prompted to consume these blueprint, visual, and FEA reports as engineering feedback, revise the CadQuery program and selector metadata, and resubmit a STEP artifact for up to 10 attempts. To evaluate this setting, we introduce Hephaestus-CCX (H-CCX), a benchmark of 50 engineering briefs collected from patents, supplier datasheets, engineering standards, regional industrial catalogs, and engineering competitions, each paired with executable requirement checkers. Each case asks for an assembled STEP artifact and is graded by whether the generated CAD satisfies the stated physical and geometric contract, not by whether it matches one reference mesh. Our experiments show that this task remains nearly unsolved even for current frontier models. In the main Codex and Claude Code sweep, 400 first attempts do not produce a single strict-passing artifact, and one FEA-feedback round adds only one strict pass across another 400 revised submissions. Notably, partial-credit metrics show that the tools still move models in the right direction: 21-view feedback raises GPT-5.5 from 19.4% to 29.3% mean requirement pass on Hephaestus-CCX and from 0.397 to 0.505 IoU on Fusion 360 , while blueprinting raises its S2O IoU from 0.444 to 0.592. Repeating the feedback loop compounds these gains. In our longest GPT-5.5/high run, the model spends 68 minutes per item on average, nearly a 7\times increase over the 10-minute two-attempt setting, and mean requirement pass rises from 38.8% to 60.5% with 9/50 strict-passing artifacts. This suggests that test-time compute can scale stably when it is organized as structured engineering feedback, not simply when it is spent as a larger one-shot reasoning budget. This paper makes two contributions. • An engineering-grounded CAD-agent task. We move CAD generation toward assembled STEP artifacts that are judged by geometric checks and finite-element analysis requirements, not only by reference matching or visual plausibility. To support future work on this setting, we release Hephaestus-CCX, a 50-case benchmark of single-part and multi-part engineering briefs paired with CalculiX evaluation kits and typed pass/fail requirement checkers. • A study of feedback for CAD agents. We implement structured blueprints, rich-view visual inspection, and FEA retry feedback inside production coding-agent harnesses. We measure where each feedback source improves frontier model performance, and how repeated feedback-driven repair compounds these gains over time. Figure 2: Overview of the CAD-agent pipeline. A free-form engineering brief is converted into an optional schema-v4 blueprint, decomposed into construction units, assembled into a STEP artifact by a deterministic controller, and revised using rich-view inspection and FEA feedback. The controller owns execution, measurement, composition, and validation, while the agent owns design decisions and CAD-code