Recursive Knowledge Synthesis for Multi-LLM Systems: Stability Analysis and Tri-Agent Audit Framework
Toshiyuki Shigemura · 2026
Read Recursive Knowledge Synthesis for Multi-LLM Systems: Stability Analysis and Tri-Agent Audit Framework by Toshiyuki Shigemura (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08839.txt.
Introduction
Toshiyuki Shigemura builds a team of three chat models that check each other in a loop. One model drafts text. A next model checks if the draft holds up. A third model checks if the work is clear and can be traced. The loop runs more than once, so each round can fix the last.
He calls this loop Recursive Knowledge Synthesis. The claim is that the loop makes a whole that no one model can match on its own. He also gives ways to test if the loop stays stable, or if it drifts with each round. A reader who builds model teams gets both a plan and a test frame. It helps judge when a team loop helps, and when it just adds cost.
Catalog record
| CREATOR | Toshiyuki Shigemura |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08839
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Recursive Knowledge Synthesis for Multi-LLM Systems: Stability Analysis and Tri-Agent Audit Framework Toshiyuki Shigemura Abstract This paper presents a tri-agent cross-validation framework for analyzing stability and explainability in multi-model large language systems. The architecture integrates three heterogeneous LLMs—used for semantic generation, analytical consistency checking, and transparency auditing—into a recursive interaction cycle. This design induces Recursive Knowledge Synthesis (RKS) , where intermediate representations are continuously refined through mutually constraining transformations irreducible to single-model behavior. Across 47 controlled trials using public-access LLM deployments (October 2025), we evaluated system stability via four metrics: Reflex Reliability Score (RRS) , Transparency Score (TS) , Deviation Detection Rate (DDR) , and Correction Success Rate (CSR) . The system achieved mean RRS = 0.78 ± 0.06 =0.78\pm 0.06 and maintained T S ≥ 0.8 TS\geq 0.8 in about 68% of trials. Approximately 89% of trials converged, supporting the theoretical prediction that transparency auditing acts as a contraction operator within the composite validation mapping. The contributions are threefold: (1) a structured tri-agent framework for coordinated reasoning across heterogeneous LLMs, (2) a formal RKS model grounded in fixed-point theory, and (3) empirical evaluation of inter-model stability under realistic, non-API public-access conditions. These results provide initial empirical evidence that a safety-preserving, human-supervised multi-LLM architecture can achieve stable recursive knowledge synthesis in realistic, publicly deployed environments. 1 Multi-Agent System Dynamics and Computational Stability Research into multi-agent large language model (LLM) systems increasingly prioritizes internal consistency and computational stability. This paper presents a three-agent architecture structured to facilitate recursive cross-validation for generating robust, verifiable knowledge states. The central challenge is preventing logical drift while ensuring outputs reflect high-coherence collective consensus. Most state-of-the-art work in autonomous reasoning, including Chain-of-Thought (CoT) [ 7 ] , ReAct [ 3 ] , and Reflexion [ 1 ] , focuses on enhancing single-LLM capabilities through prompt chaining or internal monologue. Model evaluation techniques like LLM-as-a-Judge [ 9 ] and safety mechanisms like Constitutional AI [ 2 ] impose constraints within monolithic or homogeneous systems. This study diverges from single-agent paradigms by evaluating stability through coordinated heterogeneous, cross-vendor LLMs (OpenAI, Google, Microsoft) in a tri-layer design: Semantic, Analytical, and Audit modules. This approach quantifies stability benefits from disparate model architectures and training biases. We term this dynamic Recursive Knowledge Synthesis (RKS) , where knowledge iteratively refines into an emergent state irreducible to any single agent. Our objective is to quantify tri-layer audit stability and validate internal consistency metrics for automated, verifiable reasoning. The investigation focuses exclusively on core tri-agent interaction dynamics. To isolate cross-validation architecture effects, we exclude external linguistic pre-conditioning (e.g., role-based scripting) or stochastic perturbation, ensuring observed stability derives from internal coordination rather than external artifacts. 2 Related Work 2.1 Multi-Agent LLM Systems Recent research explores coordinated multi-agent LLM architectures, including debate-based reasoning [ 10 ] and “society of mind” frameworks for distributed cognitive processing. These methods show how heterogeneous agents can collectively refine reasoning accuracy through adversarial critique or parallel perspectives. 2.2 Self-Correction and Iterative Refinement Approaches such as Reflexion [ 1 ] , ReAct [ 3 ] , and SelfRefine [ 6 ] focus primarily on single-agent improvement through systematic reflection or iterative feedback. These lack an explicit theory of global stability across heterogeneous models. 2.3 Ensemble and Cross-Model Voting LLM-as-a-Judge [ 9 ] demonstrates the value of cross-model evaluation but does not provide stability guarantees or explicit recursive synthesis mechanisms. Existing ensemble methods remain heuristic. 2.4 Interpretability and Task Partitioning in Large-Scale Systems Recent interpretability research has emphasized the importance of isolating computation paths. OpenAI’s sparse-circuit analysis [ 14 ] demonstrates that fine-grained circuit decomposition improves traceability of language model behavior. Similarly, distributed-systems research [ 13 ] shows that task partitioning is essential for reducing marginal inefficiency in coordinated multi-node systems. Our use of Session-Level Role Decomposition (SLRD) draws inspiration from both lines of work by applying the same principles—decomposition and controlled interaction—to multi-LLM reasoning workflows. 2.5 Distinction and Contribution of This Work This study uniquely provides (1) a tri-agent, cross-vendor validation architecture, (2) a formal fixed-point theoretical basis for convergence, and (3) empirical stability evaluation under real-world conditions. 3 Tri-Agent Architecture and Cross-Validation Cycle Our system employs a three-module architecture, structured to enforce distinct computational and validation roles. The system is composed of: • Semantic Reasoning Module ( M_{S} ) (ChatGPT (OpenAI)): Ensures linguistic instantiation, semantic coherence, and structural validity of the knowledge output. • Analytical Consistency Module ( M_{A} ) (Gemini (Google)): Enforces logical fidelity, theoretical consistency, and conceptual integrity against a pre-defined knowledge base. • Transparency Audit Module ( M_{T} ) (Copilot (Microsoft)): Maintains auditable ethical and safety criteria, acting as a constraint-enforcer on intermediate outputs. An External Supervisor manages the initial context provisioning and oversees the high-level Cross-Validation Cycle . The cycle involves a continuous exchange where the output of one module serves as the constrained input for the next, compelling iterative refinement. For instance, M_{S} generates an initial response; M_{A} audits its logical consistency; M_{T} audits the combined output for compliance; and the results feedback into M_{S} for semantic reformation. This recursive structure forms the basis of the RKS process. Figure 1: Tri-agent cross-validation architecture showing the External Supervisor coordinating the Semantic Module ( M_{S} ), Analytical Module ( M_{A} ), and Transparency Audit Module ( M_{T} ) through control and recursive feedback loops. 3.1 Empirical Weighting for System Stability System performance is quantified using the Reflex Reliability Score (RRS) , a composite metric capturing the overall stability and self-correction capacity. Based on the observed influence distribution across 47 trials, the RRS is computed as a weighted sum of the constituent metrics: RRS=0.3\times TS+0.4\times DDR+0.3\times CSR These weights were selected based on observed failure modes: insufficient deviation detection was the most common cause of system instability across trials. Accordingly, DDR was assigned the highest weight (40%) to reflect its critical role in maintaining validated knowledge coherence and system stability. The Transparency Score (TS) and Correction Success Rate (CSR) provide regulatory feedback necessary for convergence management. The internal diagnostic for detected cognitive bias, B , is derived directly from the normalized Transparency Score ( TS_{\text{norm}}\in[0,1] ): B=1-TS_{\text{norm}} In our 47-trial log, the inferred bias term B remained consistently below 0.2, indicating a stable operational range for the Transparency Audit Module. The bias term B provides an operational diagnostic for M_{T} and functions as a dampening factor in reliability computations. Figure 2: Weight distribution of the Reflex Reliability Score (RRS), showing relative contributions of Transparency Score (TS, 30%), Deviation Detection Rate (DDR, 40%), and Correction Success Rate (CSR, 30%) to overall system stability. 4 Transparency Audit Module and Audit Thresholds Transparency Audit Module ( M_{T} ) governs systemic integrity, analogous to a control barrier function. It enforces verifiability and algorithmic compliance by dynamically auditing intermediate outputs from M_{S} and M_{A} , serving as a computational safety regulator against pre-defined ethical and safety criteria. The module’s performance is quantitatively assessed via the Transparency Score (TS) , a measure of output explainability and internal traceability. TS is formally defined as the average of the Explainability Coefficient ( E_{c} ) and the Traceability Parameter ( T_{p} ): TS=\frac{E_{c}+T_{p}}{2} A specific threshold of TS\geq 0.7 is established as the baseline for high auditable transparency . Any output state that violates this TS<0.7 criterion