DynaGraph : Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration

Yanxing Guo 1, , Zihao Zheng 1,∗ , Fangzhou Wu 2 , Ling Liang 1,3, , Lin Bao 1,3,4 , Zongwei Wang 1,3,5 , Yimao Cai 1,3,† 1 Peking University, 2 Nanjing University, 3 Beijing Advanced Innovation Center for Integrated Circuits, 4 Beijing University of Posts and Telecommunications, 5 Yanxin Co. Ltd · 2026

Read DynaGraph : Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration by Yanxing Guo 1, , Zihao Zheng 1,∗ , Fangzhou Wu 2 , Ling Liang 1,3, , Lin Bao 1,3,4 , Zongwei Wang 1,3,5 , Yimao Cai 1,3,† 1 Peking University, 2 Nanjing University, 3 Beijing Advanced Innovation Center for Integrated Circuits, 4 Beijing University of Posts and Telecommunications, 5 Yanxin Co. Ltd (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29511.txt.

Introduction

Yanxing Guo and six colleagues present DynaGraph, a lightweight framework letting models tackle reasoning. Pipelines risk cascading errors, while agent teams drift and bloat memory, so DynaGraph reconfigures its topology on the fly. Time-shared adapter modules over one shared base model fit training and inference on a consumer graphics card. An evaluator triggers small patches for local gaps or rebuilds for logical breaks. Their eight-billion-parameter system nearly matches a seventy-two-billion-parameter model on benchmarks while cutting latency and token use by roughly two-thirds.

Catalog record

CREATORYanxing Guo 1, , Zihao Zheng 1,∗ , Fangzhou Wu 2 , Ling Liang 1,3, , Lin Bao 1,3,4 , Zongwei Wang 1,3,5 , Yimao Cai 1,3,† 1 Peking University, 2 Nanjing University, 3 Beijing Advanced Innovation Center for Integrated Circuits, 4 Beijing University of Posts and Telecommunications, 5 Yanxin Co. Ltd
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31723
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29511

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DynaGraph : Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration Yanxing Guo 1, , Zihao Zheng 1,∗ , Fangzhou Wu 2 , Ling Liang 1,3, , Lin Bao 1,3,4 , Zongwei Wang 1,3,5 , Yimao Cai 1,3,† 1 Peking University, 2 Nanjing University, 3 Beijing Advanced Innovation Center for Integrated Circuits, 4 Beijing University of Posts and Telecommunications, 5 Yanxin Co. Ltd Abstract Tackling complex reasoning tasks typically relies on massive monolithic LLMs, which suffer from severe computational redundancy. While task decomposition through structured pipelines or multi-agent collaborations offers an alternative, these approaches inevitably fall into a critical dilemma: predefined static topologies are highly vulnerable to cascading errors, whereas unconstrained dynamic agents suffer from trajectory divergence and unpredictable memory bloat. To address this, we present DynaGraph , a lightweight multi-model framework driven by dynamic topological reconfiguration. At the execution level, DynaGraph multiplexes time-division PEFT adapters over a shared base model, enabling both full system training and inference deployment on a single consumer-grade GPU. At the routing level, the Evaluator continuously monitors execution confidence to trigger hierarchical self-healing: Fine-grained Patching for localized data gaps and Subgraph Reconstruction for severe logical ruptures. Experiments on StrategyQA, MATH, and FinQA demonstrate our 8B model closely approximates the reasoning capabilities of a 72B monolithic model (e.g., 87.6% on StrategyQA, 82.7% on MATH). Furthermore, it reduces latency by up to 68.1% and token consumption by 68.6% compared to unconstrained dynamic architectures. 1 Introduction In recent years, LLMs have demonstrated unprecedented capabilities in the field of natural language processing 7 . However, as technology advances, the application scenarios of LLMs have expanded to complex tasks requiring deep logical deduction, such as multi-hop question answering, mathematical reasoning, and financial risk analysis 33 ; 9 ; 30 . Currently, solving such tasks typically relies on extremely large-scale monolithic models, such as GPT-4 (estimated 1.8T parameters) 21 , Claude 3.5 Sonnet, or Llama 3-70B 7 . Unfortunately, relying on a single massive model to handle all segments within a task pipeline not only introduces severe computational redundancy but also limits the system’s flexibility for modular expansion of specific capabilities. To mitigate the limitations of monolithic models on complex tasks, existing solutions primarily focus on augmenting the single-model paradigm. Prompting techniques like CoT 29 and ToT 34 guide intermediate reasoning, while RAG 1 integrates external knowledge. Alternatively, MoE 14 scales capacity via sparse activation. However, these methods face architectural bottlenecks. Despite heuristic pruning, prompt-based paradigms operate within predefined, rigid topologies lacking reactive runtime self-healing, making them vulnerable to cascading failures from localized anomalies. Meanwhile, MoE remains a highly coupled system demanding steep memory overhead, which prevents independent modular hot updates. Consequently, decomposing tasks into multi-agent systems has emerged as an alternative 10 . However, current collaborative frameworks struggle to balance controllability and flexibility, typically falling into a dilemma between two extremes: 1) Static DAG Pipelines: These offer predictable overheads but lack reactive recovery mechanisms. Localized errors inevitably accumulate along the task chain, leading to severe cascading failures 38 . 2) Unconstrained Dynamic Reflection: Autoregressive agents exhibit high autonomy but are prone to trajectory divergence and meta-cognitive hallucinations 12 ; 20 . Their repeated trial-and-error leads to unpredictable computational costs and severe GPU memory bloat. Thus, developing a collaborative system that achieves convergent, efficient self-correction under a strictly controlled budget remains a critical challenge. To address these challenges, we present DynaGraph , a lightweight multi-model system with dynamic topological reconfiguration. The framework shifts from static task scheduling to adaptive topological evolution via a real-time feedback loop. At the execution layer, DynaGraph multiplexes LoRA adapters over a shared backbone, maintaining a constant \mathcal{O}(1) GPU memory footprint regardless of expert pool size. At the control layer, the Evaluator monitors real-time execution confidence, instantly halting flawed reasoning steps. Based on error severity, it adaptively triggers hierarchical interventions: Fine-grained Patching to suture localized information gaps, or Subgraph Reconstruction to truncate and regenerate severely corrupted branches. This paradigm endows the system with robust self-healing, ensuring trajectory convergence under strict operational budgets. In summary, our contributions are three-fold: • Lightweight Architecture: DynaGraph multiplexes time-division PEFT adapters over a shared base model. This bounds the peak memory footprint to 16.6 GB, enabling complex multi-model inference on a single consumer-grade GPU. • Adaptive Topological Self-Healing: A state-aware reconfiguration mechanism balances execution structure and autonomy. By dynamically deploying Fine-grained Patching to suture localized data gaps and Subgraph Reconstruction to truncate and regenerate fatally corrupted logic branches, the system guarantees reasoning convergence while halting cascading errors. • Efficiency and Performance Breakthrough: Our 8B-scale DynaGraph achieves superior performance (e.g., 87.6% on StrategyQA, 82.7% on MATH), closely approximating 72B massive models. Compared to unconstrained dynamic architectures like Reflexion, it reduces token consumption and latency by up to 68.6% and 68.1%. 2 Background 2.1 Large Language Models Large Language Models (LLMs) (e.g., Gemini 25 and Qwen 32 ) exhibit remarkable capabilities across domains like mathematical reasoning 5 and commonsense question answering 24 , propelled by scaling laws 15 and emergent abilities 28 . However, monolithic LLMs often struggle with complex multi-domain tasks. To address this, models are frequently fine-tuned on specialized datasets. For instance, domain-specific fine-tuning in financial 30 , biomedical 17 , and legal 3 fields yields superior specialized performance without sacrificing general capabilities. These successes inspire the use of parameter-efficient fine-tuning (PEFT) methods, such as prompt tuning 19 and LoRA 11 , for efficient domain adaptation. Figure 1: Macro architecture and dynamic topology evolution of DynaGraph . (a) Macro Architecture illustrating component interactions. (b) Exception Handling and Reconstruct Mechanism through dynamic node insertion and branch replacement. 2.2 Model Interaction 2.2.1 Single-Model-Based Interaction To enhance reasoning within a single-model paradigm, techniques like Chain-of-Thought (CoT) 29 , zero-shot triggers 16 , and task-breakdown prompts 37 guide intermediate logical deductions. Furthermore, Retrieval-Augmented Generation (RAG) 18 mitigates hallucinations by grounding outputs in external corpora. Nevertheless, single-model approaches remain vulnerable to biased prompts 26 , error accumulation in long inference chains 20 , and retrieval-generation misalignment 13 , limiting their efficacy on complex tasks. 2.2.2 Multi-Model-Based Interaction Multi-model interactions overcome single-model bottlenecks by decomposing tasks across distinct reasoning modules. Frameworks like Tree of Thoughts 34 and Graph of Thoughts 2 organize reasoning into structured topologies suitable for branching and backtracking. Concurrently, Mixture-of-Experts (MoE) architectures enhance efficiency and accuracy by routing inputs to relevant experts 36 , especially when incorporating fine-grained specialization 6 and instruction-tuning 22 . Despite their effectiveness, existing multi-model frameworks construct static topologies that cannot adapt to real-time execution states and lack autonomous self-repair mechanisms. DynaGraph directly addresses these limitations by introducing dynamic topological reconstruction, pushing multi-model interaction into a resilient, adaptive frontier. 3 Method Figure 2: A concrete execution example of DynaGraph . The Evaluator halts execution upon detecting anomalies at node v_{2} ; a dynamically inserted patch node subsequently recovers the corrupted state to ensure convergence. 3.1 Task Formulation and System Overview 3.1.1 Formalization of Task and DAG In complex reasoning scenarios, task resolution requires collaborative routing among specialized modules, which we define as the model interaction topology . This paradigm decomposes instructions into a graph where nodes represent expert executions and edges denote contextual dependencies. We propose this to overcome the inherent limitations of existing frameworks: static pipelines are highly vulnerable to cascading

Read the complete text