Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration

Haoxiang Luo, Yinqiu Liu, Ruichen Zhang, Jiacheng Wang, Gang Sun · 2025

Read Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration by Haoxiang Luo, Yinqiu Liu, Ruichen Zhang, Jiacheng Wang, Gang Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00672.txt.

Introduction

Haoxiang Luo and co-authors survey in 2025 how teams of large language models could run at the network edge. Edge computing processes data near its source for speed, but classic edge models falter on tangled, shifting tasks needing reasoning and multiple data types. Fleets of specialized language models, cooperating, might fill the gap.

The survey traces the path from single edge models to multi-model systems, covering orchestration, resource scheduling, and knowledge sharing between models. Trust looms large: the authors stress verification, privacy, and robust decisions when many models vote. Designs where models split by data type, text, image, audio, also feature, along with efficiency directions.

Catalog record

CREATORHaoxiang Luo, Yinqiu Liu, Ruichen Zhang, Jiacheng Wang, Gang Sun
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00672

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration Thanks: H. Luo, G. Sun, and H. Yu are with the School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China (e-mail: [email protected]; {gangsun, yuhf}@uestc.edu.cn). Thanks: Y. Liu, R. Zhang, J. Wang, and D. Niyato are with the College of Computing and Data Science, Nanyang Technological University, Singapore 639798 (e-mail: [email protected]; {ruichen.zhang, jiacheng.wang, dniyato}@ntu.edu.sg). Thanks: Z. Xiong is with the School of Electronics, Electrical Engineering and Computer Science (EEECS), Queen’s University Belfast, Belfast BT7 1NN, U.K. ([email protected]). Thanks: X. Wang is with the Department of Electrical and Computer Engineering, Western University, London N6A 5B9, Canada (e-mail: [email protected]). Thanks: X. Shen is with the Department of Electrical and Computer Engineering, University of Waterloo, Waterloo N2L 3G1, Canada (e-mail: [email protected]). Thanks: The corresponding author: Gang Sun. Haoxiang Luo, Yinqiu Liu, Ruichen Zhang, Jiacheng Wang, Gang Sun Abstract Edge computing enables real-time data processing closer to its source, thus improving the latency and performance of edge-enabled AI applications. However, traditional AI models often fall short when dealing with complex, dynamic tasks that require advanced reasoning and multimodal data processing. This survey explores the integration of multi-LLMs (Large Language Models) to address this in edge computing, where multiple specialized LLMs collaborate to enhance task performance and adaptability in resource-constrained environments. We review the transition from conventional edge AI models to single LLM deployment and, ultimately, to multi-LLM systems. The survey discusses enabling technologies such as dynamic orchestration, resource scheduling, and cross-domain knowledge transfer that are key for multi-LLM implementation. A central focus is on trusted multi-LLM systems, ensuring robust decision-making in environments where reliability and privacy are crucial. We also present multimodal multi-LLM architectures, where multiple LLMs specialize in handling different data modalities—such as text, images, and audio—by integrating their outputs for comprehensive analysis. Finally, we highlight future directions, including improving resource efficiency, trustworthy governance multi-LLM systems, while addressing privacy, trust, and robustness concerns. This survey provides a valuable reference for researchers and practitioners aiming to leverage multi-LLM systems in edge computing applications. I Introduction I-A Background Edge computing has emerged as a crucial paradigm to bring intelligent services closer to data sources (sensors, cameras, vehicles, drones) in networks [ 1 ] . By processing data at or near the network edge, computational data exchange-related latency and bandwidth usage can be greatly reduced, thus improving quality-of-service for many time-sensitive intelligent applications such as traffic management, emergency response, and autonomous navigation [ 2 ] . Traditional edge Artificial Intelligence (AI) systems, however, typically rely on specialized narrow models, each designed for a specific task, e.g., object detection or traffic prediction [ 3 ] . While effective for targeted problems, these conventional models lack the flexibility and general reasoning capabilities required to address the increasingly complex and dynamic environments, such as in modern urban and aerial ecosystems. In contrast, large pre-trained models, especially large language models (LLMs), have demonstrated remarkable human-level proficiency in understanding, generating, and reasoning over natural language and multimodal data [ 4 ] , [ 5 ] , [ 6 ] . Their generalist intelligence enables them to perform a wide variety of tasks without task-specific retraining, making them highly attractive for diverse edge applications where versatility and adaptability are essential [ 7 ] , [ 8 ] , [ 9 ] . As a result, the integration of LLMs with edge computing leads to the emerging concept of Edge General Intelligence (EGI), where edge nodes, such as Internet of Things (IoT) devices, vehicles, drones, and city infrastructure, gain enhanced context awareness, reasoning capabilities, and multimodal interaction [ 2 ] , [ 10 ] , [ 11 ] . This evolution enables smarter, more autonomous, and adaptive services directly at the edge, reducing reliance on cloud connectivity and accelerating decision-making processes. However, the deployment of LLMs at the edge introduces unique challenges, including limited on-device compute resources, energy constraints, and high communication overhead for cloud interactions [ 12 , 13 ] . To alleviate these difficult problems, a few solutions have been recently developed. Researchers adopted techniques such as model compression [ 14 ] , pruning, quantization, and knowledge distillation [ 15 ] to reduce the model size and reasoning complexity to adapt to edge devices. Furthermore, some works have designed energy-saving reasoning, scheduling, and dynamic model invocation strategies [ 16 ] , [ 17 ] rationally allocating tasks to extend the battery life of the equipment. Furthermore, methods such as edge-local inference enhancement and edge-cloud collaborative computing have been proposed to deal with high communication overhead [ 18 ] . Just as LLMs empower edge computing, moving towards EGI, researchers have found that there are still limitations when individual LLMs work. Different LLMs, perhaps with different training data, languages, or specialties, can complement each other [ 19 ] . Indeed, answers from different LLMs to the same query often vary due to their diverse training corpora and model biases [ 20 ] . A single LLM faces difficulty in adapting to heterogeneous contexts (e.g., a traffic management LLM might not handle medical queries) [ 21 ] . Additionally, individual LLMs can suffer from outdated knowledge or hallucinations if their training data is limited [ 22 , 23 ] . Multi-LLM systems have been proposed as a way to push the frontier of EGI by having multiple LLMs collaborate. We can combine their strengths and mitigate individual weaknesses by harnessing multiple LLMs as an ensemble or a network [ 24 ] , [ 25 ] . For example, Wang et al. leveraged a pool of LLMs (including GPT-3.5, GPT-4, LLaMA variants, and others) to jointly generate comprehensive elderly care plans, outperforming any single model in coverage of topics [ 26 ] . Likewise, researchers have begun exploring multi-LLM systems to simulate “group intelligence,” where LLM-based agents discuss or vote on answers to improve reliability [ 27 ] . It is also regarded as the prerequisite foundation for a multi-agent system [ 28 ] . Although these efforts are still in their infancy, they indicate a paradigm shift toward collaborative intelligence at the edge. Facing the extensive demand for EGI and recognizing the unique advantages provided by multi-LLM, this paper provides a comprehensive survey of multi-LLM in implementing ubiquitous EGI applications. Before starting the discussion, we summarize the relevant key features of EGI, multi-LLM, and multi-LLM through Fig. 1 . The following content will elaborate on this in sequence. Fig. 1: Key features for EGI, multi-LLM, and multi-LLM for EGI. I-B Related Surveys To clarify the coverage of the existing relevant surveys and highlight our uniqueness, we have summarized the contributions and priorities of the related work. They are divided into two aspects: LLM for EGI and multi-LLM, which are concluded in TABLE I . TABLE I: Summary of Related Surveys Scope Ref. Overview LLM Multi-LLM Edge computing LLM for EGI [ 2 ] A survey on three conceptual architectures of LLM-licensed EGI: centralized, hybrid, and decentralized, and their implementation methods ✓ ✗ ✓ [ 29 ] An overview of an efficient memory fine-tuning and model compression in LLM to facilitate its deployment at the network edge ✓ ✗ ✓ [ 30 ] A

Read the complete text