1-2-3 Check: Enhancing Contextual Privacy in LLM via Multi-Agent Reasoning
Wenkai Li, Liwen Sun, Zhenxiang Guan, Xuhui Zhou, Maarten Sap · 2025
Read 1-2-3 Check: Enhancing Contextual Privacy in LLM via Multi-Agent Reasoning by Wenkai Li, Liwen Sun, Zhenxiang Guan, Xuhui Zhou, Maarten Sap (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07667.txt.
Description
Wenkai Li and four co-authors present a 2025 arXiv framework for keeping private details private when language models juggle mixed information. A model summarizing a meeting must repeat the public decisions while swallowing the personal asides, and single models leak. Their design splits the privacy work among specialized agents: some extract candidate details, others classify them, with rounds of checking between.
By shrinking what any one agent must hold in mind, the framework adheres to context-specific privacy norms more reliably. The team also mapped how mistakes cascade, showing when an early miss becomes a later leak. On two benchmarks, their best setup cut private information leakage by about eighteen to nineteen percent with a leading commercial model, while keeping public content intact. The lesson is architectural: privacy improves when the plumbing of information flow is designed, not hoped for.
Catalog record
| CREATOR | Wenkai Li, Liwen Sun, Zhenxiang Guan, Xuhui Zhou, Maarten Sap |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07667