PIArena : A Platform for Prompt Injection Evaluation

Runpeng Geng, Chenlong YinYanting WangYing ChenJinyuan JiaThe Pennsylvania State University {runpeng, chenlong, yanting, yingchen, jinyuan}@psu.edu · 2026

Read PIArena : A Platform for Prompt Injection Evaluation by Runpeng Geng, Chenlong YinYanting WangYing ChenJinyuan JiaThe Pennsylvania State University {runpeng, chenlong, yanting, yingchen, jinyuan}@psu.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08499.txt.

Description

Geng and four colleagues offer PIArena, a single extensible platform for judging prompt injection attacks and defenses across tasks and benchmarks. Its dynamic attack adapts injected prompts from defense feedback, exposing weak spots in current defenses. Evaluations find limited generalization across tasks, vulnerability to adaptive attacks, and deep trouble when an injected task matches the target task, showing why unified testing matters for security claims.

Catalog record

CREATORRunpeng Geng, Chenlong YinYanting WangYing ChenJinyuan JiaThe Pennsylvania State University {runpeng, chenlong, yanting, yingchen, jinyuan}@psu.edu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79005
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08499

Browse the full library · About the Tower of Babel