Instruction Bleed: Cross-Module Interference in Prompt-Composed Agentic Systems
Ching-Yu Lin, Yifan Liu · 2026
Read Instruction Bleed: Cross-Module Interference in Prompt-Composed Agentic Systems by Ching-Yu Lin, Yifan Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26356.txt.
Introduction
Ching-Yu Lin and Yifan Liu name a quiet failure in agents assembled from prompt modules. Edit one module, and unrelated modules change their behaviour, though nothing executable connects them. They call it instruction bleed, formally compositional behavioural leakage. Shared context windows have no walls: transformer attention mixes every module with every other. Their probe runs on a live job-evaluation agent across many trials.
Three perturbation channels test the bleed. Changing the volume or the form of neighbouring modules does nothing detectable. Changing their content does: a paired effect of moderate size appears, with a confidence interval clear of zero. No single recommendation flipped, so ordinary quality checks see nothing. Deployed agents make thousands of decisions, though, and a sub-threshold nudge compounds. The authors supply a definition, a reusable protocol, and predictions others can falsify.
Catalog record
| CREATOR | Ching-Yu Lin, Yifan Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26356
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Instruction Bleed: Cross-Module Interference in Prompt-Composed Agentic Systems Ching-Yu Lin, Yifan Liu Abstract Practitioners of prompt-composed agentic systems report a recurring failure mode: editing one prompt module silently shifts the behavior of others despite no shared variable or executable dependency. We formalize this as compositional behavioral leakage (CBL): interference between modules sharing a context window. CBL is enabled by architectural non-isolation: transformer self-attention provides no formal boundary between concatenated modules. We probe CBL on a deployed job-evaluation agent (Claude Sonnet 4.6, 144 trials) through a reusable three-channel protocol that perturbs non-focal modules along volume , content , and form . Only the content channel produces a detectable paired effect (Cohen’s d = 0.63 d=0.63 , bootstrap 95% CI excluding zero); no recommendation flipped—a sub-threshold regime invisible to standard QA but compounding across the thousands of decisions a deployed agent makes. CBL is orthogonal to known agent-failure axes (adversarial injection, cognitive degradation, multi-agent fault propagation, privacy leakage). We contribute an operational definition, a reusable protocol, a falsifiable prediction set, and a system-class characterization, establishing cross-module interference measurement as a requirement for prompt-composed agent evaluation. 1 Introduction Prompt-composed agentic systems—where an agent’s behavior is assembled at runtime from natural-language modules rather than written as executable code, and a large language model (LLM) interprets the composed context as the agent’s policy—are a fast-growing deployment pattern. Practitioners of these systems already report a recurring failure mode: editing one prompt module silently shifts the behavior of an unrelated module, with no shared variable, tool call, or executable dependency to explain it ( 15 ) . The locus of risk is therefore the composition mechanism itself, not any single module. OpenClaw ( 14 ) typifies this deployment pattern at production scale: 379K GitHub stars and over 10K community-authored skill modules, with users composing personality definitions (SOUL.md), capability modules (SKILL.md), and orchestration rules (AGENTS.md) into agent configurations that no single author fully audits. The same pattern recurs across mechanism choices—markdown convention ( 14 ; 7 ) , template engines ( 17 ) , and Python class inheritance ( 8 ) —with non-trivial behavioral logic carried in text the LLM interprets and code restricted to deterministic I/O (§ 2 , Table 1 ). The architectural assumption that composing prompt modules yields the composition of their individual behaviors is not warranted by transformer self-attention, which computes global pairwise interactions across the composed context with no module-level isolation: a ### Persona heading is a writing convention, not a namespace boundary. Proactive interference ( 16 ) and coverage-bounded compositional generalization ( 2 ) jointly predict that each novel module combination is a distribution shift whose behavioral consequences are not derivable from per-module evaluation. Yet no existing agent benchmark measures whether modifying one prompt module silently alters a semantically unrelated module’s behavior—making compositional behavior under module-set shift a first-order safety and reliability concern for deployed agents. We make four contributions: • We give an operational definition of compositional behavioral leakage (CBL)—behavioral interference between co-resident prompt modules in a shared attention context—and distinguish it from compositional privacy leakage ( 11 ) , longitudinal cognitive degradation, and adversarial prompt injection. • We instantiate a reusable three-channel protocol on a deployed job-evaluation agent (Claude Sonnet 4.6; 12 JDs, 144 trials), providing an existence proof of cross-module interference ( d=0.63 on the semantic-content channel; condition C2, Table 2 )—running on artifacts other prompt-composed systems already produce. • We derive a falsifiable prediction set framing the multi-system replication program, requiring no new measurement infrastructure beyond what current agent deployments emit. • We place prompt-composed agentic systems on a composition-mechanism spectrum across four open-source projects, establishing them as a distinct system class within agentic systems. 2 Prompt-Composed Agentic Systems 2.1 The Pattern A prompt-composed agentic system is one in which non-trivial behavioral decision logic—scoring rubrics, workflow sequencing, persona definitions, tool-selection criteria—is encoded in human-authored text files an LLM interprets via attention rather than executes via a runtime. 2.2 Four Systems Table 1 surveys four open-source prompt-composed agent systems spanning a composition-mechanism spectrum from markdown convention ( 14 ; 7 ) through Jinja2 templating ( 17 ) to Python class inheritance ( 8 ) . In every case behavioral logic resides in text the LLM interprets via attention; code handles only deterministic I/O. As systems mature, composition migrates outward (conventions \to templates \to class inheritance \to prompt-management services)—tacit acknowledgment that text-level composition is fragile. Yet the most widely deployed systems (OpenClaw, AGENTS.md/CLAUDE.md across thousands of repositories) still compose at the text level. Appendix A provides per-system descriptions and the full maturation pattern. The absence of a formal characterization of when and how this fragility manifests motivates the definition we introduce in § 3 . Table 1: Four prompt-composed agentic systems spanning a composition-mechanism spectrum. None asserts behavioral output of prompts in CI. System Format Composition Files Beh. tests OpenClaw Markdown Convention SOUL/SKILL + 10K skills Manual only career-ops Markdown Convention 18 modes + CLAUDE.md Struct. lints OpenHands Jinja2 {% include %} 51 .j2 Rendering only aider Python Inheritance 19 _prompts.py Parser tests 3 The Failure Mode: Compositional Behavioral Leakage 3.1 Operational Definition Let \mathcal{M}=\{m_{1},\ldots,m_{n}\} be a deployed prompt-module set concatenated into an LLM’s input context, and let \mathcal{M}^{(j\leftarrow e)} denote the same module set after applying an edit e to a non-focal module m_{j} . Let s_{i}(x;\mathcal{M}) denote the observable score or decision associated with a focal module m_{i} on input x . We say the system exhibits compositional behavioral leakage (CBL) when an edit e that is not intended to affect the focal behavior induces a detectable paired shift: \Delta_{i}(e)=\mathbb{E}_{x}\left[s_{i}(x;\mathcal{M}^{(j\leftarrow e)})-s_{i}(x;\mathcal{M})\right], where the paired-effect bootstrap confidence interval excludes zero. The stricter singleton comparison \mathcal{B}(m_{i}\mid\mathcal{M})\approx\mathcal{B}(m_{i}\mid\{m_{i}\}) is a compositional-consistency test and can be viewed as a special case of this regression view. In this paper, we focus on the deployed-system setting: whether localized edits to non-focal prompt modules silently shift focal module behavior under the full deployed prompt. CBL differs from three adjacent failure modes. Compositional privacy leakage ( 11 ) : multi-agent output aggregation reveals sensitive information (privacy vs. behavior; multi-agent vs. single-agent topology). Cognitive degradation ( 1 ) : longitudinal state drift across multi-step execution (runtime accumulation vs. initialization interference). Prompt injection : adversarial external inputs subvert behavior (malicious vs. accidental). Practitioners refer to CBL informally as “instruction bleed” ( 15 ) ; we formalize it. 3.2 Mechanisms Predicting CBL Four properties of transformer LLMs make CBL plausible and yield testable predictions. Each contributes a distinct interference mechanism; together they make composition syntax itself a behavioral variable. Attention is global. Transformer self-attention computes pairwise token interactions across the entire input. There is no architectural mechanism restricting attention to tokens within a single prompt module: a ### Persona heading is a statistical hint, not a scope boundary, and its effectiveness depends entirely on training-distribution priors over similar formatting in pre-training data. Delimiter-based isolation is therefore a behavioral expectation, not a guarantee. This non-isolation property does not by itself prove leakage in any particular system, but it removes the formal basis for assuming that delimiter-separated modules behave independently. Proactive interference. Wang and Sun ( 16 ) demonstrate that LLM retrieval accuracy declines log-linearly with accumulated interfering context, even when the target is positioned immediately before the query. Prompt-engineering mitigations (“ignore