SHM-Agents: A Generalist-Specialist Integrated Agent System for Structural Health Monitoring
Yuequan Bao \affilnum 1 \affilnum 2 \affilnum 3, Xing Li \affilnum 3, Huabin Sun \affilnum 3, Dawei Liu \affilnum 3, Yuxuan Tian \affilnum 3, Haiyang Hu \affilnum 3 · 2026
Read SHM-Agents: A Generalist-Specialist Integrated Agent System for Structural Health Monitoring by Yuequan Bao \affilnum 1 \affilnum 2 \affilnum 3, Xing Li \affilnum 3, Huabin Sun \affilnum 3, Dawei Liu \affilnum 3, Yuxuan Tian \affilnum 3, Haiyang Hu \affilnum 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12916.txt.
Introduction
Bao and five colleagues present SHM-Agents, a system that pairs large language models with specialist tools for structural health monitoring of structures like bridges. Users drive single or combined monitoring tasks in plain language, from spotting data anomalies to updating finite-element models and judging fatigue. Tests on a long-span cable-stayed bridge show it handles the full task range accurately and fast, with a modular design that allows easy expansion.
Catalog record
| CREATOR | Yuequan Bao \affilnum 1 \affilnum 2 \affilnum 3, Xing Li \affilnum 3, Huabin Sun \affilnum 3, Dawei Liu \affilnum 3, Yuxuan Tian \affilnum 3, Haiyang Hu \affilnum 3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57235 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12916
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SHM-Agents: A Generalist-Specialist Integrated Agent System for Structural Health Monitoring Yuequan Bao \affilnum 1 \affilnum 2 \affilnum 3, Xing Li \affilnum 3, Huabin Sun \affilnum 3, Dawei Liu \affilnum 3, Yuxuan Tian \affilnum 3, Haiyang Hu \affilnum 3 Abstract Artificial intelligence is increasingly used to simplify complex tasks. In engineering applications of structural health monitoring (SHM), existing specialized algorithms, while effective, often face high implementation barriers, limited interoperability and complex training procedures. To overcome these challenges, this paper proposes SHM-Agents, a generalist–specialist agent system that integrates the reasoning and planning abilities of large language models with the problem-solving strengths of specialized algorithms. SHM-Agents enables end-to-end execution of single and combined SHM tasks via natural language, supports deep learning pre-training to simplify deployment and allows flexible expansion through a modular design. Experiments on a long-span cable-stayed bridge show that SHM-Agents can accurately and efficiently perform diverse SHM tasks, including data anomaly diagnosis and recovery, signal processing, statistical analysis, modal identification, damage identification, finite element model updating, vehicle load modeling, response calculation, reliability assessment, fatigue estimation and bridge knowledge Q&A. keywords Structural health monitoring, Agent, Large language model, Deep learning † † runninghead: Yuequan Bao and Xing Li † † affiliation: \affilnum 1Key Lab of Smart Prevention and Mitigation of Civil Engineering Disasters of the Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin \affilnum 2Key Lab of Structures Dynamic Behavior and Control of the Ministry of Education, Harbin Institute of Technology, Harbin \affilnum 3School of Civil Engineering, Harbin Institute of Technology, Harbin † † corresponding: Yuequan Bao, chool of Civil Engineering, Harbin Institute of Technology, 73Huanghe Road, Harbin 150001, China. 1 Introduction In recent years, rapid advances in artificial intelligence have led to the emergence of numerous large language models, including GPT( [ OpenAI et al.(2024) ] ), DeepSeek( [ DeepSeek-AI et al.(2024) ] ), LLaMA( [ Kumar et al.(2024)Kumar, Sharma and Bedi ] ) and Gemini( [ Gemini Team et al.(2025) ] ), which have demonstrated remarkable capabilities in natural language understanding and task execution. Consequently, the application of artificial intelligence to complex engineering problems has become a major research focus because of its potential to streamline workflows and improve efficiency. However, owing to the inherent limitations of large language models, their outputs are predominantly text-based, which prevents them from independently completing complex tasks. To overcome this limitation, researchers have proposed large language model-based agents (LLM agents). Figure 1: The Architecture of LLM Agents. Figure 2: The functions of the SHM-Agents. LLM agents are systems designed to enable large language models (LLMs) to reason through problems, formulate solutions and execute plans using a suite of tools. Their primary function is to serve as intermediaries between LLMs and APIs or other external tools, allowing LLMs to leverage these resources to accomplish complex tasks, as illustrated in Figure 1 . To streamline agent development, researchers have introduced numerous open-source frameworks ( [ Jain(2022) ] , [ Qian et al.(2024) , Alon et al.(2019)Alon, Zilberstein, Levy and Yahav , Duan and Wang(2024) , Hong et al.(2024) , Wang et al.(2024)Wang, Liu, Zhang and Yang , Shinn et al.(2023)Shinn, Cassano, Gopinath, Narasimhan and Yao , Lozhkov et al.(2024) , Schick et al.(2023) , Webb et al.(2025)Webb, Mondal and Momennejad ] ), including ChatDev ( [ Qian et al.(2024) ] ), Auto-GPT ( [ Alon et al.(2019)Alon, Zilberstein, Levy and Yahav ] ), MetaGPT ( [ Hong et al.(2024) ] ), LangChain ( [ Wang et al.(2024)Wang, Liu, Zhang and Yang ] ) and LangGraph ( [ Duan and Wang(2024) ] ). The introduction of these frameworks has substantially reduced the complexity of agent construction, thereby accelerating their adoption across various domains ( [ Arslan et al.(2024)Arslan, Ghanem, Munawar and Cruz , Jie et al.(2025) , Xiong et al.(2024)Xiong, Jin, Lu and Zhang , Sun et al.(2024) , Mendible-Barreto et al.(2025)Mendible-Barreto, Díaz-Maldonado, Carmona Esteva, Torres, Córdova-Figueroa and Colón , Yepes et al.(2024)Yepes, You, Milczek, Laverde and Li , Han et al.(2025) , Kim et al.(2025)Kim, Hur and Min , Wu and Fard(2025) , Prasai et al.(2025)Prasai, Du, Zhang and Yang , Wang et al.(2025) , Sun et al.(2025b) , Fang et al.(2024)Fang, Bindu, Gupta, Zhan and Kang , Wang et al.(2026)Wang, Guo, Zheng, Wang, Zheng and Qi ] ), such as aerospace, biology, chemistry, law and finance. [ Mendible-Barreto et al.(2025)Mendible-Barreto, Díaz-Maldonado, Carmona Esteva, Torres, Córdova-Figueroa and Colón ] proposed a modular multi-agent LLM framework for scientific tasks, enabling the collaborative execution of complex workflows through the flexible integration of customized Python functions. Building on this framework, they developed DynaMate, a system that automates the generation, execution and analysis of molecular simulations. [ Wang et al.(2026)Wang, Guo, Zheng, Wang, Zheng and Qi ] proposed an LLM-based LRC agent for human–robot collaboration that integrates chain-of-thought reasoning, few-shot learning and contextual memory. Experiments in aerospace wire harness assembly demonstrated that the agent can accurately interpret instructions, plan tasks effectively and support flexible and efficient robotic operations. [ Jie et al.(2025) ] introduced Agent4Vul, a multimodal LLM-agent framework for smart contract vulnerability detection that incorporates Commentator and Vectorizer agents within a multimodal learning architecture. The results showed that Agent4Vul outperformed a broad range of baseline methods and surpassed existing state-of-the-art AI models. [ Sun et al.(2025b) ] investigated digital twins constructed using LLM agents to simulate human multi-turn interactions with Amazon Rufus. Their findings indicated that these digital twins reproduced human-like behavioral patterns while enabling scalable evaluation of agentic AI systems. [ Xiong et al.(2024)Xiong, Jin, Lu and Zhang ] proposed MEDRAG, a medical retrieval-augmented generation framework that integrates medical corpora, retrieval modules and backbone LLMs for medical question answering. Experimental results showed that MEDRAG improved answer accuracy, reduced hallucinations and outdated information and provided practical guidance for the design of medical RAG systems. In the field of SHM, establishing an effective monitoring system is essential for tracking structural operating conditions, predicting potential damage and deformation trends and ensuring structural safety ( [ Mei et al.(2015)Mei, Li and Lu , Ye et al.(2013)Ye, Ni, Wai, Wong, Zhang and Xu , Deng et al.(2019)Deng, Yan and Nie , Ye et al.(2012)Ye, Ni, Wong and Ko ] ). Based on monitoring data, image, traffic information and finite element model, the SHM system performs structural analysis using specialized algorithms( [ Jiao et al.(2021)Jiao, Wang, Chen, Ruan, Ye and Alavi , He et al.(2022)He, Li, Salehi, Zhang, Zhou and Jiao , Han et al.(2021)Han, Jiao and Zhu , Alavi et al.(2018)Alavi, Jiao, Buttlar and Lajnef , Bao et al.(2019)Bao, Chen, Wei, Xu, Tang and Li , Li et al.(2020)Li, Cai, Qin and Deng , Pan et al.(2023)Pan, Bao and Li , Chen et al.(2021)Chen, Liu and Sun , Bao et al.(2024)Bao, Liu and Li , Bao et al.(2020)Bao, Guo and Li , Hou et al.(2025)Hou, Che and Bao , Xu et al.(2019a)Xu, Bao, Chen, Zuo and Li , Xu et al.(2019b)Xu, Wei, Bao and Li , Sun et al.(2025a)Sun, Guan, Bao, Xu and Li , Li et al.(2024)Li, Geng and Chen , Sun and Bao(2025) , Bao and Tian(2025) , Asgarieh et al.(2014)Asgarieh, Moaveni and Stavridis , Sanayei et al.(2015)Sanayei, Khaloo, Gul and Catbas , Ribeiro et al.(2012)Ribeiro, Calçada, Delgado, Brehm and Zabel , Pan and Bao(2025) ] ), including