LLMs for Engineering: Teaching models to design High Powered Rockets

Toby Simonds · 2025

Read LLMs for Engineering: Teaching models to design High Powered Rockets by Toby Simonds (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19394.txt.

Introduction

Toby Simonds tested whether language models can design high-powered rockets in 2025. Models shine at writing code, but designing physical machines is a different test. A benchmark called RocketBench links models to detailed rocket simulators and sets two jobs: hit a target height, then land with precision.

Top models showed solid textbook knowledge at first try. Given simulator feedback, though, they improved poorly and stalled below skilled human designers. Extra training with rewards changed the story: a modest-sized tuned model beat both the big general models and human experts. The study suggests practice with feedback, not raw size, unlocks engineering skill.

Catalog record

CREATORToby Simonds
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19394

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs for Engineering: Teaching models to design High Powered Rockets Toby Simonds Abstract Large Language Models (LLMs) have transformed software engineering, but their application to physical engineering domains remains underexplored. This paper evaluates LLMs’ capabilities in high-powered rocketry design through RocketBench, a benchmark connecting LLMs to high-fidelity rocket simulations. We test models on two increasingly complex design tasks: target altitude optimization and precision landing challenges. Our findings reveal that while state-of-the-art LLMs demonstrate strong baseline engineering knowledge, they struggle to iterate on their designs when given simulation results and ultimately plateau below human performance levels. However, when enhanced with reinforcement learning (RL), we show that a 7B parameter model outperforms both SoTA foundation models and human experts. This research demonstrates that RL-trained LLMs can serve as effective tools for complex engineering optimization, potentially transforming engineering domains beyond software development. A Preprint 1 Introduction Large Language Models (LLMs) have significantly transformed software engineering practices, yielding quantifiable improvements in code generation, debugging processes, and documentation development. Studies demonstrate productivity enhancements of 55% on various software development task completion Git [1] . Despite these documented efficiency gains in computational domains, LLMs’ applications to mechanical, aerospace, civil, and other physical engineering disciplines remain underdeveloped. This disparity raises a fundamental research question: Can LLMs function as effective tools for engineering tasks beyond software development? To explore this hypothesis, we selected high-powered rocketry as an ideal test domain for several compelling reasons. First, rocket design represents a well-bounded yet complex engineering challenge with clear performance metrics. Second, the physics of rocketry incorporates multiple engineering disciplines (aerodynamics, structural mechanics, propulsion systems) while remaining computationally tractable. Third, the domain offers a straightforward way to quantify success through metrics such as altitude accuracy and landing precision. Finally, model rocketry provides a practical analogue to more complex aerospace engineering challenges while remaining accessible for research purposes. This paper presents an interface enabling LLMs to design model rockets using RocketPy [ 2 ] , a high-fidelity trajectory simulation tool. We evaluate these models on rocket design tasks inspired by the Spaceport America Cup competition, requiring optimization for target altitude, structural integrity, landing precision, and cost efficiency—challenges that mirror real-world engineering constraints. Our findings reveal that while state-of-the-art LLMs demonstrate impressive baseline knowledge of engineering principles, they struggle to iteratively improve designs through simulation feedback — a critical capability for real-world engineering tasks. Even after numerous iterations, these models plateau below human performance, indicating limitations in their ability to fully optimize complex multi-parameter designs. By implementing reinforcement learning (RL) approaches, we demonstrate that these limitations can be overcome, enabling LLMs to achieve performance that surpasses human experts. Our RL-trained models achieved precision landings within 12 meters of targets and consistently outperformed human designs across multiple metrics, despite using a relatively modest 7B parameter model architecture. The results point to a future where LLMs could transform engineering practice across numerous disciplines once effective interfaces with domain-specific tools are established. This work offers a glimpse of engineering’s future, where LLMs serve not merely as information retrieval systems but as creative problem-solvers capable of generating and optimizing novel designs beyond human capabilities. Key Contributions • RocketBench: A benchmark for evaluating LLMs’ rocket design capabilities • Analysis of current LLMs strengths in engineering domains • Demonstration that RL-trained LLMs significantly outperform both larger foundation models and human experts. 2 Related Work RL for Engineering Design Reinforcement learning has demonstrated significant efficacy in advancing engineering and scientific capabilities. AlphaFold transformed protein structure prediction [ 10 ] , while AlphaTensor [ 8 ] discovered novel matrix multiplication algorithms with superior computational efficiency (Fawzi et al., 2022). Similarly, AlphaDev [ 7 ] optimized low-level sorting algorithms beyond human-designed solutions, and Alpha Chip [ 9 ] enhanced semiconductor design through systematic exploration of parameter spaces. These systems primarily leverage traditional RL methodologies with domain-specific reward structures. Our approach diverges by employing language models as the base policy, leveraging their baseline engineering knowledge and physical reasoning capabilities. This integration of structured domain priors with reinforcement learning enables more sample-efficient optimization while maintaining domain flexibility, addressing a fundamental limitation of previous approaches that require extensive task-specific engineering. 3 Methodology 3.1 Simulation Env Our simulations were built on RocketPy, a high-fidelity trajectory simulation library for high-power rocketry. RocketPy provides a complete 6 degrees of freedom (6-DOF) simulation framework that accounts for variable mass effects, aerodynamic forces, and parachute descent phases with exceptional accuracy. The library has been validated against real-world flight data, demonstrating relative errors of less than 2% for apogee predictions across multiple documented test flights [ 2 ] . For our research, we enhanced RocketPy with custom design rule checks (DRCs) and timeout mechanisms to address common failure modes observed during initial testing. DRCs included basic constraints including verification that body diameter exceeded motor diameter and that body length was greater than motor length to ensure proper component integration. These additions prevent simulation failures caused by physically impossible configurations and terminate excessively long computations that often result from unrealistic rocket parameters. To enable LLMs to interface with the simulation environment, we developed a JSON interface that abstracts the complexity of RocketPy into a structured configuration format. Through this interface, models can specify all critical rocket parameters including motor selection, dimensions, materials, and launch conditions. See Table 1 for full list. Both motors and materials were limited to pre-curated lists of commercially available options to ensure physical realism and manufacturability. For motors, we selected a range of commercial solid rocket motors commonly used in high-power rocketry, varying in total impulse, burn duration, and thrust profiles. LLMs were passed detailed specifications for physical dimensions, propellant mass, and thrust information derived from manufacturer data. We also implemented a material stress simulation module that evaluates structural integrity throughout the flight profile. This module identifies the point of maximum stress during the mission and determines whether the rocket maintains structural integrity, adding a critical dimension of realism to the performance evaluation. The simulation incorporated an economic model to introduce realistic cost constraints into the design process. Total costs were computed as a function of motor selection and material volume, with standardized per-unit prices assigned to each material type based on market averages. Motor costs were assigned fixed values reflecting their relative price differences while maintaining consistent cost pressure across designs. This economic dimension compelled LLMs to navigate performance-cost tradeoffs, simulating the budget optimization challenges inherent in real-world engineering projects. By incorporating this cost function into the reward signal, we ensured that design solutions reflected not only technical performance but also resource efficiency—a critical constraint in practical rocket engineering. Table 1: Configurable Rocket Parameters Component Parameter Description Motor Motor Choice Selection from available commercial motors Rocket Body Radius Body radius in meters (must exceed motor radius) Length Body length in meters Material Selection from available materials Thickness Wall thickness in meters Nose Cone Shape Conical, ogive, elliptical, tangent, von karman, etc. Length Nose cone length in meters Material Selection from available materials Fins Number Number of fins around the rocket body Root Chord Length of fin base in meters Tip Chord Length of fin tip in meters Span Fin height in meters Cant Angle Fin angle in degrees Material Selection from available materials Thickness Fin thickness in

Read the complete text