AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applications
Leming Shen 1 , Qiang Yang 2 , Yuanqing Zheng 1 , Mo Li 3 · 2025
Read AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applications by Leming Shen 1 , Qiang Yang 2 , Yuanqing Zheng 1 , Mo Li 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05346.txt.
Introduction
Leming Shen, Qiang Yang, Yuanqing Zheng, and Mo Li present a system that turns plain-language wishes into working programs for sensor networks, in a 2025 paper. Homes and cities bristle with sensors and actuators, but programming them takes specialists. Large language models read sensor data well, yet sending raw data to their servers costs money, leaks privacy, and hides the reasoning. Their system, AutoIOT, instead writes a readable local program.
Users state what they want in words. The system drafts documented code, then improves it through rounds of self-checking with little user effort. The finished program runs on site, so data stay home and each step can be inspected. Tests and user studies across varied tasks showed the generated programs matching or beating standard baselines. The authors pitch the approach as programming for the connected world, open to non-programmers.
Catalog record
| CREATOR | Leming Shen 1 , Qiang Yang 2 , Yuanqing Zheng 1 , Mo Li 3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05346
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applications Leming Shen 1 , Qiang Yang 2 , Yuanqing Zheng 1 , Mo Li 3 Abstract . The advent of Large Language Models (LLMs) has profoundly transformed our lives, revolutionizing interactions with AI and lowering the barrier to AI usage. While LLMs are primarily designed for natural language interaction, the extensive embedded knowledge empowers them to comprehend digital sensor data. This capability enables LLMs to engage with the physical world through IoT sensors and actuators, performing a myriad of AIoT tasks. Consequently, this evolution triggers a paradigm shift in conventional AIoT application development, democratizing its accessibility to all by facilitating the design and development of AIoT applications via natural language. However, some limitations need to be addressed to unlock the full potential of LLMs in AIoT application development. First, existing solutions often require transferring raw sensor data to LLM servers, which raises privacy concerns, incurs high query fees, and is limited by token size. Moreover, the reasoning processes of LLMs are opaque to users, making it difficult to verify the robustness and correctness of inference results. This paper introduces AutoIOT , an LLM-based automated program generator for AIoT applications. AutoIOT enables users to specify their requirements using natural language (input) and automatically synthesizes interpretable programs with documentation (output). AutoIOT automates the iterative optimization to enhance the quality of generated code with minimum user involvement. AutoIOT not only makes the execution of AIoT tasks more explainable but also mitigates privacy concerns and reduces token costs with local execution of synthesized programs. Extensive experiments and user studies demonstrate AutoIOT ’s remarkable capability in program synthesis for various AIoT tasks. The synthesized programs can match and even outperform some representative baselines. Conference: ; CCS: Computing methodologies Artificial intelligence CCS: Computer systems organization Embedded and cyber-physical systems Conference: The 31st Annual International Conference on Mobile Computing and Networking; Nov 4–8, 2025; Hong Kong, China The 31st Annual International Conference on Mobile Computing and Networking (ACM MobiCom ’25), Nov 4–8, 2025, Hong Kong, China DOI: 10.1145/xxxxxxx.xxxxx ISBN: nnn-n-nnnn-nnnn-n/nn/nn 1. Introduction Artificial Intelligence of Things (AIoT) ( Lee et al., 2024 ; Cai et al., 2023 ; Wen et al., 2024 ; Huang and Gao, 2022 ; Shen and Zheng, 2023 ; Liu et al., 2021 ) is an emerging paradigm that leverages advanced artificial intelligence (AI) algorithms to process a vast amount of data generated by Internet of Things (IoT) devices. This technology brings a new level of intelligence and automation to various applications, including healthcare ( Ouyang et al., 2024 ; Ouyang et al., 2023 ) , smart sensing ( Yang and Zheng, 2023 ; Yang et al., 2023 ; Yang and Zheng, 2022 ) , and autonomous driving ( He et al., 2023 ) . Recent advances in large language models (LLMs) ( e . g ., GPT-4 ( Achiam et al., 2023 ) ) fundamentally changed the way we interact with AI. While initially designed to understand natural languages, recent pioneering works ( Xu et al., 2024 ; Liu et al., 2023 ; Ji et al., 2024 ) have demonstrated considerable proficiency of LLMs in exploiting embedded world knowledge by interpreting IoT sensor data to perform various AIoT tasks. Recent works ( Xu et al., 2024 ) term such an endeavor – Penetrative AI. Fig. 1 illustrates how LLMs can be tasked to comprehend and even interact with the physical world through integration with IoT sensors and actuators. Figure 1. Illustration of how LLMs can sense and interact with the physical world in AIoT applications. However, current LLMs on AIoT tasks ( Xu et al., 2024 ; Liu et al., 2023 ; Quan et al., 2025 ) fall short in supporting AIoT applications ( Yu et al., 2024b ; Yu et al., 2024a ; Hou et al., 2024 ; Hou et al., 2023 ; Cao et al., 2022 ; Hou et al., 2025 ) : 1) The trustworthiness of the inference results is compromised since the inference process is performed inside a "black box" and opaque to users. Thus, the robustness of the applications or the correctness of the inference results are hard to verify; 2) Transmitting the raw or intermediate sensor data from user devices to LLM servers raises privacy concerns, incurs prohibitive query fees, and increases response latency; 3) Sensor data typically exhibits extensive length and high dimensionality, making remote processing at LLM servers infeasible due to token limits ( Yang et al., 2024 ; tok, 2025 ) . Ideally, the integration of LLMs with AIoT applications should be trustworthy, privacy-preserving, and communication-efficient. On the other hand, existing works on LLMs have showcased their remarkable capabilities in code generation to accomplish a variety of programming tasks ( Le et al., 2023 ; Jiang et al., 2023 ; Luo et al., 2023 ) . Can we leverage LLMs to synthesize programs to fulfill AIoT application requirements? This approach can 1) enhance the explainability and trustworthiness of the AIoT applications as the synthesized programs can be examined and interpreted by developers, 2) mitigate privacy concerns, and reduce the communication cost since the programs can be executed locally on user devices without offloading raw sensor data, and 3) efficiently process high-dimensional continuous sensor data without being limited by the token size or bounded by the round trip time over the network. To this end, we propose AutoIOT , a user-friendly natural language programming system based on LLMs. AutoIOT automatically identifies and retrieves the necessary domain knowledge over the Internet, intelligently synthesizes programs, and evolves the programs iteratively given sample inputs and ground truth. Surprisingly, we found that the synthesized programs can sometimes outperform some representative baselines and sample programs of recent academic papers. While the automatic program synthesis for AIoT applications is promising and exciting, it entails tremendous technical challenges. 1) High Complexity of AIoT Tasks. Contrary to existing works that generate code for individual modules or well-defined functions ( Austin et al., 2021 ) , AIoT applications typically need a systematic design and integration involving multiple functional components, leading to much higher reasoning and planning complexity beyond the capability of current LLMs. To address this issue, AutoIOT decomposes the programming task into several distinct modules and generates the corresponding code segments. In particular, AutoIOT leverages chain-of-thought (CoT) prompts ( Wei et al., 2022 ) to divide the task into a few sub-tasks and integrate their solutions, eventually making the sub-tasks manageable by LLMs. 2) Lack of Domain Knowledge in AIoT. LLMs are trained on pre-collected general corpus datasets, which may not include the latest domain-specific knowledge needed for the development of various emerging AIoT applications. To tackle this problem, AutoIOT guides the LLMs to search and retrieve necessary knowledge and algorithms, thereby enabling in-context training and inference augmented with domain knowledge for LLMs. 3) Heavy Intervention and Constant Feedback. Our preliminary experiments (§ 2.2 ) reveal that to generate functionally correct programs, developers have to give timely feedback to LLMs and constantly intervene in the entire development process. For example, developers need to provide specific reference materials and describe algorithms in great detail, which can be time-consuming and defeat the very purpose of automated natural language programming. Ideally, AutoIOT should be able to