A Novel Multi-Agent Architecture to Reduce Hallucinations of Large Language Models in Multi-step Structural Modeling
Ziheng Geng, Jiachen Liu, Ran Cao, Lu Cheng, Dan M. Frangopol, Minghui Cheng · 2026
Read A Novel Multi-Agent Architecture to Reduce Hallucinations of Large Language Models in Multi-step Structural Modeling by Ziheng Geng, Jiachen Liu, Ran Cao, Lu Cheng, Dan M. Frangopol, Minghui Cheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-07728.txt.
Introduction
Geng and colleagues build a multi-agent setup cutting false outputs in structural modeling with large language models. Existing agents struggle as false outputs and error buildup grow across long sequences. Plan agents extract key inputs and form a step plan, while node and element agents build frame geometry at once, then a load agent follows. Code writer agents turn shape and load information into ready OpenSeesPy scripts. On 20 frame problems over ten trials, the system scores full marks in 18 cases and 90 percent in two.
Catalog record
| CREATOR | Ziheng Geng, Jiachen Liu, Ran Cao, Lu Cheng, Dan M. Frangopol, Minghui Cheng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46562 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.07728
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Novel Multi-Agent Architecture to Reduce Hallucinations of Large Language Models in Multi-step Structural Modeling Ziheng Geng, Jiachen Liu, Ran Cao, Lu Cheng, Dan M. Frangopol, Minghui Cheng Abstract Large language models (LLMs) such as GPT and Gemini have demonstrated remarkable capabilities in contextual understanding and reasoning. The strong performance of LLMs has sparked growing interest in leveraging them to automate tasks traditionally dependent on human expertise. Recently, LLMs have been integrated into intelligent agents capable of operating structural analysis software (e.g., OpenSees) to construct structural models and perform analyses. However, existing LLMs are limited in handling multi-step structural modeling due to frequent hallucinations and error accumulation during long-sequence operations. To this end, this study presents a novel multi-agent architecture to automate the structural modeling and analysis using OpenSeesPy. First, problem analysis and construction planning agents extract key parameters from user descriptions and formulate a stepwise modeling plan. Node and element agents then operate in parallel to assemble the frame geometry, followed by a load assignment agent. The resulting geometric and load information is translated into executable OpenSeesPy scripts by code translation agents. The proposed architecture is evaluated on a benchmark of 20 frame problems over ten repeated trials, achieving 100% accuracy in 18 cases and 90% in the remaining two. The architecture also significantly improves computational efficiency and demonstrates scalability to larger structural systems. Keywords: Large language models, Multi-agent architecture, Structural analysis, Hallucination 1 Introduction Structural analysis is a fundamental pillar of civil engineering, underpinning the design and evaluation of buildings and infrastructure to ensure their safety, stability, and serviceability. Over the past several decades, finite element modeling has emerged as the dominant approach for conducting structural analysis due to its accuracy, versatility, and broad applicability. A variety of commercial and open-source software platforms, such as OpenSees ( 18 ) , ETABS ( 5 ) , SAP2000 ( 6 ) , ANSYS ( 2 ) , and Abaqus ( 7 ) , have been widely adopted in both academia and industry. Despite these technical advances, structural modeling using finite element software is multi-step and remains highly manual and labor-intensive. Engineers are required to perform a series of repetitive steps, such as defining nodes and elements, assigning material properties, applying load patterns, and specifying boundary conditions. These tasks are typically executed through graphical user interfaces (GUIs), which depend on click-based operations and demand considerable domain expertise. Such manual workflows hinder modeling efficiency, underscoring the need for automation in structural analysis. Trained on massive text datasets and consisting of billions of parameters, large language models (LLMs) such as GPT ( 19 ) and Gemini ( 12 ) have demonstrated remarkable capabilities in contextual understanding ( 1 ; 30 ) , logical reasoning ( 4 ; 25 ) , and instruction following ( 28 ; 27 ) . These breakthroughs have sparked growing interest in leveraging LLMs to automate tasks traditionally dependent on human expertise. Within the structural engineering community, initial efforts have been made to evaluate LLM’s structural engineering ability. 23 established a dataset of strength of materials problems and found that general-purpose LLMs are not accurate in solving these problems. To overcome these challenges, supervised fine-tuning and retrieval-augmented generation are employed to integrate domain knowledge. Successful applications include textual interpretations of structural damage images and building surface defects ( 13 ; 26 ) , generation of construction inspection reports ( 20 ; 24 ) , and information query of building codes and standards ( 14 ; 22 ) . Another major direction lies in the development of agents. Specifically, the LLM serves as the central reasoning engine that plans a sequence of operations and utilizes computational tools to complete complex engineering tasks. In existing studies, agents have been developed to use Revit to generate and review building models ( 10 ; 8 ; 9 ) and to use OpenSeesPy to automate the analysis of beams and frame structures ( 17 ; 11 ; 16 ) . The aforementioned studies pioneer the application of LLMs in structural engineering and demonstrate their potential to automate and accelerate existing workflows. However, they remain limited in handling multi-step structural modeling tasks. While supervised fine-tuning and retrieval-augmented generation enable LLMs to acquire qualitative domain knowledge, they lack the quantitative reliability required for rigorous structural calculations ( 17 ) . Agents that combine the qualitative reasoning capabilities of LLMs with the numerical precision of established software are therefore more suitable for structural modeling and analysis. Nevertheless, existing agent frameworks are typically restricted to tasks involving only a small number of steps, whereas realistic structural analysis problems often require hundreds to thousands of steps to construct a valid structural model. As the number of steps increases, error accumulation and hallucination become increasingly severe, leading to invalid structural models. This issue is particularly critical in structural engineering, where even minor errors can compromise safety. Therefore, a new agent architecture is needed to scale long-horizon structural modeling while maintaining consistency, numerical accuracy, computational efficiency, and reliability against hallucination. This paper proposes a novel multi-agent architecture to reliably and efficiently perform multi-step structural modeling. The architecture decomposes the modeling workflow into four coordinated modules: analysis and planning, geometry assembly, load integration, and code translation. Specifically, problem analysis and construction planning agents first extract key parameters from user input and formulate a sequential modeling plan. The frame geometry is then constructed through parallel node and element agents, after which a load assignment agent applies the corresponding nodal and elemental loads. Finally, code translation agents transform the geometric and loading information into executable OpenSeesPy scripts. The results indicate that the proposed architecture consistently achieves accuracy exceeding 90% across 20 benchmark problems and scale to larger building structures. The remainder of the paper is organized as follows. Section 2 introduces the benchmark dataset comprising 20 representative frame problems and identifies the limitations of the existing architecture. Section 3 presents the proposed multi-agent architecture, while section 4 shows the evaluation results. Finally, Sections 5 and 6 discuss the study’s limitations and provide the concluding remarks. 2 Benchmark Dataset and Evaluation 2.1 Dataset overview A benchmark dataset developed in previous work ( 11 ) is adopted to evaluate the performance of multi-agent LLMs for automated frame structural modeling. The dataset comprises 20 representative frame problems, as illustrated in fig. 1 . Each problem features a unique structural geometry composed of vertical columns and horizontal girders. Among them, five frames have three bays and fifteen contain five bays, where each bay spans six meters. The number of stories in each bay and story heights are randomly sampled between one and five to assess the generalizability. The boundary conditions, load patterns, and material properties are consistent across all problems. Specifically, all supports are fixed at the base. A uniformly distributed load of 10 kN/m is applied downward on each girder, while a point load of 50 kN is applied rightward to the top node of each story at the leftmost bay. The material is specified by three parameters: Young’s modulus, cross-sectional area, and moment of inertia. Distinct cross-sectional properties are assigned to the columns and girders, respectively. These problems provide a systematic testbed for assessing the capability of multi-agent LLMs in solving frame structural modeling. Figure 1: