CoTGuard: Using Chain-of-Thought Triggering for Copyright Protection in Multi-Agent LLM Systems

Yan Wen, Junfeng Guo, Heng Huang · 2025

Read CoTGuard: Using Chain-of-Thought Triggering for Copyright Protection in Multi-Agent LLM Systems by Yan Wen, Junfeng Guo, Heng Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19405.txt.

Introduction

Yan Wen, Junfeng Guo, and Heng Huang build a guard for copyright in multi agent language model systems in a 2025 paper. When agents talk and reason together, protected text can leak through their inner steps, not just their final answers.

Their framework, CoTGuard, plants trigger queries in agent prompts to wake set parts of the chain of thought. It then watches those inner steps for copied content. This gives fine grained, clear detection of leaks in group agent work. Tests on several benchmarks showed the guard found leakage well with little harm to task scores. The authors argue that watching the reasoning, not just the output, is the way forward.

Catalog record

CREATORYan Wen, Junfeng Guo, Heng Huang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-19405

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CoTGuard: Using Chain-of-Thought Triggering for Copyright Protection in Multi-Agent LLM Systems Yan Wen, Junfeng Guo, Heng Huang Abstract As large language models (LLMs) evolve into autonomous agents capable of collaborative reasoning and task execution, multi-agent LLM systems have emerged as a powerful paradigm for solving complex problems. However, these systems pose new challenges for copyright protection, particularly when sensitive or copyrighted content is inadvertently recalled through inter-agent communication and reasoning. Existing protection techniques primarily focus on detecting content in final outputs, overlooking the richer, more revealing reasoning processes within the agents themselves. In this paper, we introduce CoTGuard, a novel framework for copyright protection that leverages trigger-based detection within Chain-of-Thought (CoT) reasoning. Specifically, we can activate specific CoT segments and monitor intermediate reasoning steps for unauthorized content reproduction by embedding specific trigger queries into agent prompts. This approach enables fine-grained, interpretable detection of copyright violations in collaborative agent scenarios. We evaluate CoTGuard on various benchmarks in extensive experiments and show that it effectively uncovers content leakage with minimal interference to task performance. Our findings suggest that reasoning-level monitoring offers a promising direction for safeguarding intellectual property in LLM-based agent systems. 1 Introduction Recent advances in large language models (LLMs), such as GPT-4 [ 1 ] , Genimi [ 42 ] , DeepSeek [ 13 ] , have significantly transformed natural language processing (NLP), enabling a wide array of applications across writing [ 55 ] , translation [ 57 ] , coding [ 30 ] , and reasoning [ 34 ] . Building on the generalization and zero-shot capabilities of LLMs, researchers have developed LLM-based agent systems [ 23 ] that simulate autonomous agents capable of planning cite xie2024travelplanner, collaboration [ 27 ] , and task execution [ 33 ] . These multi-agent systems leverage LLMs as their core reasoning engines, often coordinating via natural language to achieve complex objectives, from web automation to collaborative problem-solving. However, the rise of LLMs and their deployment in agent-based systems has introduced pressing concerns about intellectual property and copyright protection [ 38 , 6 ] . Much current research in LLM-related copyright protection focuses on detecting memorization or leakage of training data, watermarking generated content, and legal frameworks for model training on copyrighted corpora [ 14 , 21 , 45 , 50 , 26 ] . However, relatively little work has extended these protections to LLM-based agent systems, where models interact in more complex, emergent behaviors that make unauthorized content reproduction more challenging to trace [ 3 , 32 , 49 ] . While research on single-agent LLM copyright protection is well-established [ 5 , 62 ] , multi-agent settings introduce unique challenges due to the collaborative, distributed nature of the reasoning process [ 15 ] . Motivated by Chain-of-Thought (CoT) reasoning [ 46 ] , we identify a novel attack surface in such systems. CoT prompting is a widely adopted method that guides LLMs to produce intermediate reasoning steps before arriving at an answer, thereby improving performance on complex tasks such as arithmetic, logic, and symbolic planning [ 46 , 20 ] . Agents often exchange CoT traces rather than final answers in multi-agent settings, forming multi-step, compositional reasoning paths [ 9 , 32 ] . While beneficial for accuracy and interpretability, this intermediate reasoning structure also creates new opportunities for adversarial triggers to be injected and propagated between agents [ 47 , 59 ] . Therefore, our research aims to answer the following question: Q: How can we effectively detect copyright leakage in multi-agent LLM systems, leveraging Chain-of-Thought reasoning while minimizing disruption to task performance? The challenges of copyright protection in multi-agent LLM systems are multifaceted. Agent interactions may lead to indirect reproduction of copyrighted materials, especially when agents relay or refine information across multiple turns. The distributed nature of such systems complicates attribution and accountability. Furthermore, traditional watermarking and auditing methods may fail to detect content leakage when the reproduction is partial, paraphrased, or collaboratively generated through inter-agent dialogue. To address these challenges, we propose a trigger-based copyright protection framework that leverages CoT reasoning in multi-agent LLM systems. Instead of embedding static triggers into final outputs, our approach injects carefully designed triggers into agents’ intermediate reasoning steps, particularly in the CoT trajectories, where copyrighted material is more likely to be unintentionally recalled or reproduced. By analyzing these reasoning chains, we can detect whether agents expose protected content as they collaboratively solve tasks, even if the final answer does not contain an exact reproduction. This method enables a more fine-grained and covert detection strategy tailored to the reasoning-centric nature of LLM-based agent systems. Our contributions are threefold: • We propose a novel research problem on LLM-based Agents’ copyright protection. • We introduce a CoT-trigger mechanism for copyright protection that operates on intermediate reasoning paths in multi-agent LLMs. Besides, we develop a query-based detection framework that activates these triggers to expose potential content leakage during agent collaboration. • We validate our method on multi-agent benchmarks, demonstrating that it achieves high detection rate with minimal disruption to agents’ normal task performance. Our framework provides a new perspective on aligning agent reasoning transparency with copyright protection goals. 2 Related Works 2.1 Multi-Agent Systems Multi-agent systems (MAS) [ 8 ] have long been studied in artificial intelligence for their ability to model distributed intelligence [ 12 ] , coordination [ 24 ] , and autonomous decision-making [ 54 ] . Researches on multi-agent systems usually focus on symbolic reasoning [ 17 ] , decentralized planning [ 35 ] , and communication protocols [ 43 ] in constrained environments. With the rise of large language models, LLM-powered agents [ 28 ] have emerged as a new paradigm, where agents communicate, plan, and collaborate via natural language. Systems such as AutoGPT [ 51 , 11 ] , BabyAGI [ 29 ] , CAMEL [ 22 ] , and ChatDev [ 36 ] illustrate this transition, using LLMs to simulate agents that can assume roles, decompose problems, and dynamically coordinate to complete tasks. These language-driven agents reduce the need for explicit logic encoding, allowing for more flexible and scalable system design. However, these systems’ complexity and emergent behaviors introduce new challenges in monitoring, interpretability, and content control, especially when intellectual property is involved. 2.2 Chain-of-Thought Reasoning in Multi-Agent Systems Chain-of-Thought (CoT) prompting [ 46 ] has improved reasoning accuracy and transparency in LLMs by encouraging models to decompose problems into intermediate steps. In multi-agent settings, CoT reasoning enables agents to explain their decisions, share partial results, and coordinate more effectively through interpretable language traces [ 46 ] . Prior works such as Dialogue-Prompted CoT [ 61 ] , Reflective Agents [ 53 ] , and Plan-and-Solve agents [ 44 ] have leveraged CoT to enhance coordination and trust between agents. Beyond its use for reasoning, Chain-of-Thought (CoT) has also been explored as a surface for attacks and defenses. Some research shows that intermediate reasoning steps can unintentionally leak sensitive training data, especially when the model retrieves memorized facts during problem-solving [ 5 ] . Other work proposes to inject stealthy triggers into CoT sequences to monitor or manipulate LLM behavior [ 47 , 59 ] . Defensive approaches have similarly examined auditing CoT traces for hallucinations, bias, or misalignment

Read the complete text