When Context Hurts: The Crossover Effect of Knowledge Transfer on Multi-Agent Design Exploration

Saranyan Vigraham · 2026

Read When Context Hurts: The Crossover Effect of Knowledge Transfer on Multi-Agent Design Exploration by Saranyan Vigraham (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04361.txt.

Introduction

Saranyan Vigraham tests a common assumption in systems of cooperating software agents: that giving agents more shared context always improves their design work. He runs multi-agent software design across ten tasks and seven ways of injecting context, totalling thousands of runs.

The same kind of added document helped greatly on some tasks and hurt badly on others, and on several tasks an irrelevant document did as well as relevant ones. One simple measure, how widely agents explore with no context at all, predicted the direction of the effect strongly. Vigraham argues context should be added only after a cheap no-context trial.

Catalog record

CREATORSaranyan Vigraham
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04361

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When Context Hurts: The Crossover Effect of Knowledge Transfer on Multi-Agent Design Exploration Saranyan Vigraham Abstract The prevailing assumption in agent orchestration is that more context is better. We test this on multi-agent software design across 10 tasks, 7 context-injection conditions, and over 2,700 runs, and find a crossover effect : the same artifact type improves design exploration on some tasks (up to 20 × \times tradeoff coverage) and actively degrades it on others (up to 46% reduction). On several tasks, an irrelevant document performs as well as or better than every relevant artifact. The direction is predicted by a single measurable variable— baseline exploration without context—with Pearson r = − 0.82 r=-0.82 ( p < 0.001 p<0.001 ). Probing the mechanism by manipulating convergence pressure through prompt design reveals two distinct regimes: convergence driven by training data priors ( natural ) responds to artifact disruption, while convergence driven by explicit instructions ( induced ) does not. The implication is that context injection should be conditional, not universal: one no-context trial is a cheap diagnostic that predicts whether knowledge artifacts will help or hurt a given task. Keywords: multi-agent systems, knowledge transfer, anchoring, design exploration, LLM evaluation, context effects 1 Introduction The AI-assisted software engineering community has an untested assumption about context: more is better. Every major advance in the field has increased the amount of information available to AI agents. Context windows have grown from 4K to 1M+ tokens. Retrieval-augmented generation injects relevant documents before every query. Agent frameworks feed prior conversation, code, documentation, and design artifacts into each interaction. The assumption underlying all of these advances is that relevant context improves output quality. For code generation—producing correct implementations of specified behavior—this assumption is well-supported. An agent given a function signature, type definitions, and usage examples writes better code than one working from a bare prompt ( Chen et al. 2021 ; Li et al. 2022 ) . But software engineering is not just code generation. It is design: evaluating alternatives, weighing tradeoffs, and making architectural decisions that shape the solution space. For design work, the relationship between context and quality is more complex—and, as we show, sometimes inverted. This paper reports a controlled experiment in which we measure how knowledge artifacts from one agent team affect the design exploration of a different team solving the same problem. We test seven types of context injection—from raw deliberation transcripts to polished design documents to code—across 10 software design tasks. The tasks range from textbook problems (rate limiter, LRU cache) to domain-specific challenges (Kubernetes operator, database storage engine). 1.1 The Crossover Effect Our central finding is a crossover effect : the same knowledge artifact type produces opposite effects depending on the task. Anti-pattern documents increase tradeoff coverage by 20 \times on rate limiter (from 0.033 to 0.700, p<0.001 ) but decrease it by 9% on Kubernetes operator (from 0.475 to 0.431). Deliberation transcripts increase coverage by 17 \times on rate limiter (from 0.033 to 0.592, p<0.001 ) but decrease it by 46% on Kubernetes operator (from 0.475 to 0.256, p<0.001 ). The crossover is not random. It is predicted by a single variable: baseline exploration —the tradeoff coverage that agents achieve with no injected context. When baseline is near zero, agents converge on a default solution and context disrupts this convergence. When baseline is moderate to high, agents are already exploring and context anchors them to a specific framing. This finding has practical implications for the design of agent orchestration systems. Context injection should be conditional, gated on a measurement of baseline exploration. Unconditional context injection—the current industry default—will sometimes improve and sometimes degrade the quality of agent design work. 1.2 Contributions 1. The crossover effect in knowledge transfer. We provide the first empirical demonstration that the same knowledge artifact type can improve or degrade multi-agent design exploration, with the direction predictable from a measurable task property. This challenges the assumption that context is uniformly beneficial. 2. Baseline exploration as a diagnostic metric. We propose measuring design tradeoff coverage without context injection as a diagnostic for whether context will help or hurt. This metric is cheap to compute (run one baseline trial) and strongly predictive of artifact effectiveness ( r=-0.82 , p<0.001 ). 3. Natural vs induced convergence. We show that convergence pressure can be manipulated through prompt design, but that artifacts which disrupt natural convergence (driven by training data priors) fail to disrupt induced convergence (driven by explicit instructions). This mechanistic distinction reveals that the crossover effect depends on why agents converge, not just that they converge. 4. A reproducible evaluation method for design exploration. We introduce direct evaluation , a rubric-anchored method for measuring design tradeoff coverage that discriminates between conditions where standard evaluation (code quality, test passage) cannot. 1.3 Reproducibility All experiments use publicly available tools and models. Agent teams are 5 instances of Claude Sonnet 4 with distinct personas, run via the Claude Code CLI. Each condition uses 20 independent trials. All results reported are from runs that completed successfully ( > 30 seconds runtime), with error counts noted. No results are cherry-picked across tasks—all 10 tasks and all 7 conditions are reported regardless of whether they support our hypothesis. 2 Related Work 2.1 Context and Performance in LLMs The relationship between context length and performance has been studied extensively. Liu et al. 2024 find that LLMs struggle to use information in the middle of long contexts (“lost in the middle”), suggesting that more context is not straightforwardly better. Shi et al. 2023 show that irrelevant context can degrade reasoning performance. Our work extends these findings from single-model question answering to multi-agent design, and identifies a regime (convergent tasks) where context improves performance—creating a crossover rather than a uniform degradation. 2.2 Anchoring in LLMs Anchoring bias—disproportionate weighting of initial or salient information—has been documented in LLMs ( Jones & Steinberg 2022 ; Talboy & Fuller 2024 ) . Our crossover effect is consistent with an anchoring interpretation: injected context anchors agents to specific solutions. When agents would otherwise explore freely, this narrows the search space (harmful). When agents would otherwise converge on a single default, the anchor pulls them toward an alternative (helpful—disruption). This dual role of anchoring is novel in the LLM literature. 2.3 Multi-Agent Software Engineering ChatDev ( Qian et al. 2024 ) , MetaGPT ( Hong et al. 2024 ) , and SWE-Debate ( Yang et al. 2025 ) evaluate multi-agent systems by output quality—code correctness, test passage, issue resolution. None measure design space exploration. We argue that exploration quality is an orthogonal evaluation dimension that reveals dynamics invisible to output-focused metrics: a team can produce correct code while exploring only a fraction of the design space. 2.4 Knowledge Transfer and Design Rationale Design rationale capture ( Dutoit et al. 2006 ) records why decisions were made alongside the decisions themselves. The assumption has always been that captured rationale helps future teams. Our data complicates this: captured rationale (design documents, tradeoff lists) helps only when the receiving team would not have explored those alternatives independently. When the team is already exploring, rationale acts as an anchor rather than an enabler. 3 Method 3.1 Experimental Design The experiment has three phases: Phase 1—Baseline survey (10

Read the complete text