A Weighted Byzantine Fault Tolerance Consensus Driven Trusted Multiple Large Language Models Network

Haoxiang Luo, Gang Sun, Yinqiu Liu, Dongcheng Zhao · 2025

Read A Weighted Byzantine Fault Tolerance Consensus Driven Trusted Multiple Large Language Models Network by Haoxiang Luo, Gang Sun, Yinqiu Liu, Dongcheng Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05103.txt.

Introduction

Haoxiang Luo and co-authors design a trust system for networks of language models in a 2025 paper. Single models can be inconsistent, biased, or simply wrong, so teams now let several models answer together. But open networks may include faulty or malicious models, and a central coordinator is itself a weak point.

Their framework lets the models reach consensus by a weighted vote that tolerates bad actors, borrowing a classic method from distributed computing. Weights reflect each model's track record. The catalog title carries funding notes pasted in, but the work is the trust framework described here. Safer model teamwork matters as such networks enter open use.

Catalog record

CREATORHaoxiang Luo, Gang Sun, Yinqiu Liu, Dongcheng Zhao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05103

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Weighted Byzantine Fault Tolerance Consensus Driven Trusted Multiple Large Language Models Network Thanks: This work was supported by the Major Key Project of PCL under Grant PCL2024A05. Thanks: H. Luo, G. Sun, and H. Yu are with the School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China (e-mail: [email protected]; {gangsun, yuhf} @uestc.edu.cn). Thanks: Y. Liu and D. Niyato are with the College of Computing and Data Science, Nanyang Technological University, Singapore 639798 (e-mail: [email protected]; [email protected]). Thanks: D. Zhao is with the Pengcheng Laboratory, Shenzhen 518055, China (e-mail:[email protected]). Thanks: S. Dustdar is with the Distributed Systems Group, TU Wien, Vienna 1040, Austria, and also with the ICREA, Universitat Pompeu Fabra, Barcelona 08002, Spain (e-mail: [email protected]). Thanks: The corresponding author: Gang Sun. Haoxiang Luo, Gang Sun, Yinqiu Liu, Dongcheng Zhao Abstract Large Language Models (LLMs) have achieved remarkable success across a wide range of applications. However, individual LLMs often produce inconsistent, biased, or hallucinated outputs due to limitations in their training corpora and model architectures. Recently, collaborative frameworks such as the Multi-LLM Network (MultiLLMN) have been introduced, enabling multiple LLMs to interact and jointly respond to user queries. Nevertheless, MultiLLMN architectures raise critical concerns regarding the reliability and security of the generated content, particularly in open environments where malicious or compromised LLMs may be present. Moreover, reliance on centralized coordination undermines system efficiency and introduces single points of failure. In this paper, we propose a novel Trusted MultiLLMN framework, driven by a Weighted Byzantine Fault Tolerance (WBFT) blockchain consensus mechanism, to ensure the reliability, security, and efficiency of multi-LLM collaboration. In WBFT, voting weights are adaptively assigned to each LLM based on its response quality and trustworthiness, incentivizing reliable behavior, and reducing the impact of malicious nodes. Extensive simulations demonstrate that WBFT significantly improves both consensus security and efficiency compared to classical and modern consensus mechanisms, particularly under wireless network conditions. Furthermore, our evaluations reveal that Trusted MultiLLMN supported by WBFT can deliver higher-quality and more credible responses than both single LLMs and conventional MultiLLMNs, thereby providing a promising path toward building robust, decentralized AI collaboration networks. I Introduction Large language models (LLMs) have become a cornerstone of AI, showing great capabilities in natural language understanding and generation [ 1 ] , [ 2 ] . These LLMs, represented by ChatGPT, Deepseek, and Claude, have been widely adopted in all aspects of society, such as education, healthcare, and information technology [ 3 ] , [ 4 ] , [ 5 ] . With the deepening of LLM applications, a large number of LLMs developed by different commercial, academic, or educational organizations have emerged. However, considering the diverse learning corpus, model architectures, and training goals, the answers of different LLMs to the same query will naturally differ [ 6 ] , [ 7 ] . Additionally, a single LLM is difficult to adapt to various application scenarios with heterogeneous contexts and requirements [ 8 ] , [ 9 ] . Some LLMs even suffer from limitations and obsolescence in the training data, resulting in biased content generation and the ability to produce low-confidence outputs or hallucinations [ 10 ] , [ 11 ] , [ 12 ] . To address such challenges, the collaboration of multiple LLMs is on the agenda. For instance, Wang et al. [ 13 ] leveraged GPT-3, GPT-4o, Llama3-8B, Llama3-Chinese, Doubao, SparkDesk, Qwen, and Kimi to jointly provide care programs for the elderly. To accelerate collaboration and communication between multiple LLMs, Marro et al. [ 14 ] designed and developed a versatile, efficient, and portable communication protocol for them. This kind of collaborative LLM network is named as Multi-LLMs Network (MultiLLMN). I-A Research Motivations Despite realizing inter-LLM collaborations, MultiLLMN causes several security concerns. First, any User Equipment (UE) can access historical queries and answers. Consequently, privacy disclosure [ 15 ] and security attacks can frequently occur, especially in applications with private data such as medical and health information. In addition, malicious LLMs in MultiLLMN, such as WormGPT [ 16 ] , can not only mislead UEs, but also escalate cybersecurity threats. Even ostensibly honest LLMs may run on compromised devices, resulting in tampered or dishonest responses. Furthermore, in the MultiLLMN architecture, we typically need to employ an authoritative third party to determine the most reliable answer from the responses of multiple LLMs. The introduction of centralized authorities undermines the response efficiency of MultiLLMN and can cause single-point failures, hindering the deployment of MultiLLMN in latency-sensitive scenarios, such as autonomous driving. These concerns pose a significant challenge to the efficient collaboration of MultiLLMN and prevent UE from obtaining credible answers. Consequently, we present the following research questions. • Q1 : How can users ensure that they receive the best and trusted response from MultiLLMN in an open network environment and with potentially malicious LLMs? • Q2 : How can MultiLLMN eliminate single points of failure and achieve efficient response aggregation through multi-LLM collaboration? To answer these questions, we leverage blockchain to ensure the reliability and security of information transmission in MultiLLMNs. Specifically, blockchain consensus mechanisms enable each LLM to make decisions independently of third-party authorities through a decentralized voting process [ 17 ] , [ 18 ] . Existing research on blockchain-enabled LLMs has focused mainly on distributed training processes and the traceability of generated content, such as [ 19 ] , [ 20 ] , and [ 21 ] . However, the design of a consensus-driven MultiLLMN remains largely unexplored. Most of the existing consensus, such as Practical Byzantine Fault Tolerance (PBFT) [ 22 ] and HotStuff [ 23 ] , assign uniform trust values and equal voting weights to participants. We notice that this assumption deviates from real-world scenarios, where LLMs vary significantly in their response quality, generation capabilities, and susceptibility to malicious behavior. Consequently, applying equal voting rights across all LLMs often undermines the ability of MultiLLMN to produce the highest-quality and most trustworthy responses for UEs. Hence, the following research question is raised. • Q3 : How to assign a fair and reasonable consensus voting weight to each LLM by evaluating its trustworthiness and generation ability comprehensively, to assist MultiLLMN to generate the best quality response? As a result, it is necessary to design a Weighted Byzantine Fault Tolerance (WBFT) consensus for MultiLLMNs to reduce the voting weight of LLMs with poor response quality, weak generation ability, and possibly malicious behavior, to obtain LLM answers more accurately. I-B Our Contributions To the best of our knowledge, this is the first work to present a blockchain consensus for MultiLLMNs. Specifically, the contributions of this paper can be summarized as follows: • To avoid the limitations of a single LLM, we propose the innovative concept of MultiLLMN. Through inter-LLM collaborations, MultiLLMN mitigates biased responses and hallucinations arising from the deficiencies of individual models. • To prevent malicious LLM behaviors and enhance the efficiency of MultiLLMNs in serving UEs, we introduce a blockchain consensus mechanism to securely drive inter-LLM collaboration. Additionally, we design an improved clustering-based optimization method that dynamically adapts the MultiLLMN network structure, facilitating the formation of a Trusted MultiLLMN and further strengthening its reliability and effectiveness. • To facilitate reliable response selection in MultiLLMN, we develop the

Read the complete text