Memory Poisoning Attack and Defense on Memory Based LLM-Agents
Balachandra Devarangadi Sunil, Isheeta Sinha, Piyush Maheshwari · 2026
Read Memory Poisoning Attack and Defense on Memory Based LLM-Agents by Balachandra Devarangadi Sunil, Isheeta Sinha, Piyush Maheshwari (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05504.txt.
Description
Balachandra Devarangadi Sunil and 5 co-authors study, in a 2026 paper, how memory poisoning attacks fare against realistic medical AI agents. Such agents keep long-term memory, and attackers can plant malicious instructions through ordinary queries. Earlier work reported very high success rates under ideal conditions.
Using clinical data and three different models, the team varied starting memory, prompt counts, and retrieval settings. Pre-existing legitimate memories sharply reduced attack success, a more realistic picture than earlier results. Two defenses were tested: trust-scored moderation of inputs and outputs, and memory sanitization with time decay and pattern filtering. Careful threshold tuning proved essential, since loose settings missed attacks and strict ones blocked nearly everything.
Catalog record
| CREATOR | Balachandra Devarangadi Sunil, Isheeta Sinha, Piyush Maheshwari |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05504