PIArena : A Platform for Prompt Injection Evaluation
Runpeng Geng, Chenlong YinYanting WangYing ChenJinyuan JiaThe Pennsylvania State University {runpeng, chenlong, yanting, yingchen, jinyuan}@psu.edu · 2026
Read PIArena : A Platform for Prompt Injection Evaluation by Runpeng Geng, Chenlong YinYanting WangYing ChenJinyuan JiaThe Pennsylvania State University {runpeng, chenlong, yanting, yingchen, jinyuan}@psu.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08499.txt.
Description
Geng and four colleagues offer PIArena, a single extensible platform for judging prompt injection attacks and defenses across tasks and benchmarks. Its dynamic attack adapts injected prompts from defense feedback, exposing weak spots in current defenses. Evaluations find limited generalization across tasks, vulnerability to adaptive attacks, and deep trouble when an injected task matches the target task, showing why unified testing matters for security claims.
Catalog record
| CREATOR | Runpeng Geng, Chenlong YinYanting WangYing ChenJinyuan JiaThe Pennsylvania State University {runpeng, chenlong, yanting, yingchen, jinyuan}@psu.edu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79005 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.08499