Memory Poisoning Attack and Defense on Memory Based LLM-Agents

Balachandra Devarangadi Sunil, Isheeta Sinha, Piyush Maheshwari · 2026

Read Memory Poisoning Attack and Defense on Memory Based LLM-Agents by Balachandra Devarangadi Sunil, Isheeta Sinha, Piyush Maheshwari (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05504.txt.

Description

Balachandra Devarangadi Sunil and 5 co-authors study, in a 2026 paper, how memory poisoning attacks fare against realistic medical AI agents. Such agents keep long-term memory, and attackers can plant malicious instructions through ordinary queries. Earlier work reported very high success rates under ideal conditions.

Using clinical data and three different models, the team varied starting memory, prompt counts, and retrieval settings. Pre-existing legitimate memories sharply reduced attack success, a more realistic picture than earlier results. Two defenses were tested: trust-scored moderation of inputs and outputs, and memory sanitization with time decay and pattern filtering. Careful threshold tuning proved essential, since loose settings missed attacks and strict ones blocked nearly everything.

Catalog record

CREATORBalachandra Devarangadi Sunil, Isheeta Sinha, Piyush Maheshwari
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05504

Browse the full library · About the Tower of Babel