Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights

Wenrui Bao, Huan Wang, Jian Wang, Zhangyang Wang, Kai Wang, Yuzhang Shang · 2026

Read Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights by Wenrui Bao, Huan Wang, Jian Wang, Zhangyang Wang, Kai Wang, Yuzhang Shang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13839.txt.

Introduction

Wenrui Bao and five colleagues study another multi-agent word model talk link. It packs a sender's hidden states into a brief target weight nudge instead of adding the sender's message to the target's notes. They present TFlow, a weight-space talk frame for a known and fixed target design. With three Qwen3-4B agents, TFlow improves over a solo target by up to 8.5 hits across five tests. It keeps rival hits on four of five tests.

Catalog record

CREATORWenrui Bao, Huan Wang, Jian Wang, Zhangyang Wang, Kai Wang, Yuzhang Shang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51264
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13839

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Good Agentic Friends Do Not Just Give Verbal Advice: They Can Update Your Weights Wenrui Bao, Huan Wang, Jian Wang, Zhangyang Wang, Kai Wang, Yuzhang Shang Abstract Multi-agent LLM systems usually collaborate by exchanging natural-language messages. This interface is simple and interpretable, but it forces each sender’s intermediate computation to be serialized into tokens and then reprocessed by the receiver, thereby increasing the generated-token cost, prefill overhead, and KV-cache memory. We study an alternative communication interface: instead of appending a sender’s message to the receiver’s context, compile the sender’s hidden states into a transient, receiver-specific weight perturbation. We introduce TFlow (Thought Flow), a weight-space communication framework for a known and fixed receiver architecture. For each query, frozen role-prompted sender agents process the input, and a learned parameter generator maps their internal activations into low-rank LoRA perturbations targeting the receiver’s modules. These perturbations are fused and applied only during the receiver’s generation, enabling instance-level adaptation without permanently changing the model or enlarging the receiver’s text context. With three Qwen3-4B agents, TFlow improves over a standalone receiver by up to 8.5 accuracy points across five benchmarks while reducing processed tokens by up to 32.69%. Compared with a text-based three-agent baseline, it reduces total processed tokens by up to 83.27% and the wall-clock inference time by up to 4.6×, while maintaining competitive accuracy on four of five benchmarks. These results suggest that transient low-rank weight perturbations can serve as an executable communication medium for efficient multi-agent LLM collaboration. Project Code 1 Introduction Figure 1 : (i) Comparison between Text-based MAS and the proposed Weight-Collaboration MAS. In Text MAS, auxiliary agents transmit natural language messages to the Executor, incurring costly prefilling overhead and inflated KV cache. In contrast, our proposed paradigm compresses inter-agent communication into lightweight LoRA weight perturbations \Delta W , which are directly merged into the parameters, thereby eliminating the extra prefilling and significantly reducing the KV cache footprint. (ii) Performance overview on GSM8K . TFlow achieves accuracy competitive with TextMAS while reducing token consumption by \mathbf{76.7\%} , substantially surpassing the single-agent baseline in both accuracy and efficiency. Multi-agent LLM systems are often built like small committees. One model proposes a strategy, another contributes domain knowledge, and a final model produces the answer. This design has been effective across reasoning, coding, and tool-use settings [ 25 , 16 , 50 , 7 , 29 , 11 , 51 ] . Yet the communication interface between agents has changed surprisingly little: most systems still require each agent to write a natural-language message that is appended to another agent’s context. This text interface is attractive because it is universal and human-readable. We yet argue it might be an awkward interface between neural networks . A sender agent has already transformed the input into a rich internal state, but conventional multi-agent systems force this state to be decoded into tokens before the receiver can use it. The receiver must then encode those tokens again, paying additional prefill cost and storing a larger KV cache (Figure 1 (i)), whose memory and latency grow with context length [ 37 , 23 ] . As the number of agents or communication rounds grows, this repeated write-read cycle can dominate the cost of collaboration. The issue is not only that natural-language messages are long; it is that they make model-to-model communication pass through a channel designed for humans. Recent work has begun to question this design by allowing agents to exchange continuous representations rather than text [ 28 , 24 , 8 , 57 , 58 , 21 ] . These latent-space protocols reduce decoding overhead and can preserve information that would be difficult to express in words. However, they still require the receiver to consume sender information as activations, embeddings, or cache states. This creates a different compatibility problem: the transmitted object must be meaningful inside the receiver’s representation geometry, making such methods most natural when agents share architectures, hidden spaces, or carefully trained adapters. We explore a complementary route. Instead of sending information that the receiver must read, we send information that changes how the receiver computes. In particular, we ask whether a sender’s internal state can be compiled into a temporary low-rank perturbation of the receiver’s weights [ 17 , 18 ] . The receiver then solves the query under this perturbed computation, after which the perturbation is removed, and the frozen base model is restored. In this view, the communication object is not a sentence and not a hidden state injected into the receiver’s cache. It is a query-specific update in the receiver’s parameter space. We instantiate this idea in TFlow (Thought Flow), a framework for weight-space communication among LLM agents. We focus on a practical fixed-receiver setting: the receiver architecture and target modules are known, all LLM backbones remain frozen, and only a receiver-specific parameter generator [ 32 , 12 ] is trained. Given a query, each sender agent processes the prompted input once and exposes its hidden states as a conditioning signal. The parameter generator maps this signal into layer- and module-specific LoRA factors for the receiver. Perturbations from multiple senders are fused and injected by transiently patching the forward pass of the receiver’s target linear layers. The receiver then generates its answer without seeing any sender-written message in its text context (Figure 1 (ii)). This design separates TFlow from both text-based and latent-space collaboration. Compared with text-based MAS, TFlow avoids expanding the receiver’s input with auxiliary messages, thereby reducing generated-token usage, prefill overhead, and KV-cache growth. Compared with latent-state transfer, TFlow does not ask the receiver to directly interpret a sender’s activations. Sender states are instead translated by a learned generator into perturbations that are compatible with the receiver’s own weight tensors by construction. The result is an executable communication channel: sender information affects the receiver by modifying the computation path used for the current query. We evaluate TFlow in a three-agent setting with a frozen Qwen3-4B backbone, where sender agents provide different perspectives through hidden states and the receiver produces the final answer. Across five benchmarks, TFlow improves over the standalone receiver by up to 8.5 accuracy points while reducing total processed tokens by up to 32.69%. Relative to a text-based three-agent baseline, it cuts processed tokens by up to 83.27% and wall-clock inference time by up to 4.6x, with competitive accuracy on four of five benchmarks; the remaining gap on HumanEval+ suggests that additional generation budget matters more than inter-agent communication for code synthesis. Our contributions are: • Motivated by the high communication cost of text-based multi-agent systems, we propose weight-space communication , a new communication paradigm for multi-agent LLM collaboration, in which sender information is transmitted as transient low-rank perturbations to a frozen receiver model rather than as text appended to the receiver’s context. • Under this paradigm, we introduce TFlow , a receiver-specific framework that transforms sender hidden states into query-specific LoRA factors, integrates multiple sender contributions, and injects the resulting perturbation only during the receiver’s generation. • We demonstrate that TFlow achieves substantial efficiency gains across five reasoning, knowledge, and coding benchmarks, dramatically reducing generated-token and latency costs relative to text-based multi-agent collaboration with only negligible performance degradation, while consistently outperforming a standalone receiver. 2 Related Work

Read the complete text